Jul 09 09:52:21 devstack cinder-volume[75525]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 09:52:21 devstack cinder-volume[75525]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 09:52:21 devstack cinder-volume[75525]: we strongly recommend against using it for new projects. Jul 09 09:52:21 devstack cinder-volume[75525]: If you are already using Eventlet, we recommend migrating to a different Jul 09 09:52:21 devstack cinder-volume[75525]: framework. For more detail see Jul 09 09:52:21 devstack cinder-volume[75525]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 09:52:21 devstack cinder-volume[75525]: import eventlet # noqa Jul 09 09:52:23 devstack cinder-volume[75525]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75525) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 09:52:23 devstack cinder-volume[75525]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75525) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 09:52:23 devstack cinder-volume[75525]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75525) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 09:52:24 devstack cinder-volume[75525]: INFO dbcounter [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Registered counter for database cinder Jul 09 09:52:24 devstack cinder-volume[75525]: DEBUG oslo_db.sqlalchemy.engines [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75525) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG dbcounter [-] [75525] Writer thread running {{(pid=75525) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 09:52:25 devstack cinder-volume[75525]: INFO cinder.rpc [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 09:52:25 devstack cinder-volume[75525]: INFO cinder.rpc [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_db.sqlalchemy.engines [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75525) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:52:25 devstack cinder-volume[75525]: INFO cinder.volume.manager [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Determined volume DB was empty at startup. Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG cinder.volume.manager [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75525) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 09:52:25 devstack cinder-volume[75525]: INFO cinder.volume.manager [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 09:52:25 devstack cinder-volume[75525]: WARNING stevedore.named [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 09:52:25 devstack cinder-volume[75525]: WARNING castellan.key_manager [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 09:52:25 devstack cinder-volume[75525]: WARNING cinder.keymgr.conf_key_mgr [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG cinder.volume.drivers.lvm [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75525) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_concurrency.processutils [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75525) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_concurrency.processutils [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] CMD "cinder-rtstool verify" returned: 0 in 0.379s {{(pid=75525) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_db.sqlalchemy.engines [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75525) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:52:25 devstack cinder-volume[75525]: INFO cinder.rpc [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 09 09:52:25 devstack cinder-volume[75525]: INFO cinder.rpc [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 09 09:52:25 devstack cinder-volume[75525]: WARNING stevedore.named [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 09:52:25 devstack cinder-volume[75525]: WARNING castellan.key_manager [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 09:52:25 devstack cinder-volume[75525]: INFO cinder.volume.manager [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_db.sqlalchemy.engines [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75525) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:52:25 devstack cinder-volume[75525]: INFO oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Starting 1 workers Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Started child 75677 {{(pid=75525) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Full set of CONF: {{(pid=75525) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] ******************************************************************************** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Configuration options gathered from: {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 09:52:25 devstack cinder-volume[75677]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] ================================================================================ {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] allow_availability_zone_fallback = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] allow_compression_on_image_upload = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] allowed_direct_url_schemes = [] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] api_rate_limit = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] auth_strategy = keystone {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] az_cache_duration = 3600 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_availability_zone = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_host = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_name = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_stats_polling_interval = 60 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backup_api_class = cinder.backup.api.API {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backup_name_template = backup-%s {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backup_use_same_host = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backup_use_temp_snapshot = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] chap_password = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] chap_username = {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cinder_internal_tenant_project_id = d52db77291a5430a984c02b9984198cf {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cinder_internal_tenant_user_id = b37089c2c76a4fd2854373cab427d743 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cloned_volume_same_az = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cluster = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] compression_format = gzip {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] compute_api_class = cinder.compute.nova.API {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] config_dir = [] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] config_source = [] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] control_exchange = openstack {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] debug = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] default_availability_zone = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] default_group_type = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] default_volume_type = lvmdriver-1 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] disk_geometry = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] driver_client_cert = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] driver_client_cert_key = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] driver_data_namespace = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] driver_ssl_cert_path = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] driver_ssl_cert_verify = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] driver_use_ssl = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] enable_force_upload = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] enable_new_services = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] enable_unsupported_driver = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] enforce_multipath_for_image_xfer = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] filter_function = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] glance_api_insecure = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] glance_api_servers = ['http://192.168.122.21/image'] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] glance_api_ssl_compression = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] glance_ca_certificates_file = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] glance_catalog_info = image:glance:publicURL {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75677]: INFO cinder.volume.manager [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 09 09:52:25 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] glance_certfile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] glance_keyfile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] glance_num_retries = 3 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] glance_request_timeout = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] goodness_function = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] graceful_shutdown_timeout = 5 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] group_api_class = cinder.group.api.API {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] host = devstack {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] image_compress_on_upload = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] image_conversion_address_space_limit = 1 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] image_conversion_cpu_limit = 60 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] image_conversion_disable = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] image_upload_use_cinder_backend = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] image_upload_use_internal_tenant = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] image_volume_cache_enabled = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] image_volume_cache_max_count = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] image_volume_cache_max_size_gb = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] init_host_max_objects_retrieval = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] instance_format = [instance: %(uuid)s] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] iscsi_target_flags = {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] iscsi_write_cache = on {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] iser_helper = tgtadm {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] iser_ip_address = 192.168.122.21 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] iser_port = 3260 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] log_color = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] log_config_append = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] log_dir = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] log_file = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] log_options = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] log_rotate_interval = 1 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] log_rotate_interval_type = days {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] log_rotation_type = none {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] max_age = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] max_logfile_count = 30 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] max_logfile_size_mb = 200 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] max_over_subscription_ratio = 20.0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] message_reap_interval = 86400 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] message_ttl = 2592000 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] migration_create_volume_timeout_secs = 300 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] monkey_patch = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] monkey_patch_modules = [] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] my_ip = 192.168.122.21 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] no_snapshot_gb_quota = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] num_iser_scan_tries = 3 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] num_shell_tries = 3 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] num_volume_device_scan_tries = 3 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] nvmeof_conn_info_version = 1 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] nvmet_ns_id = 10 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] nvmet_port_id = 1 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] osapi_max_limit = 1000 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] osapi_volume_ext_list = [] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] osapi_volume_listen_port = 8776 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] osapi_volume_use_ssl = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] osapi_volume_workers = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] per_volume_size_limit = -1 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] periodic_fuzzy_delay = 60 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] periodic_interval = 60 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] public_endpoint = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] publish_errors = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] quota_backup_gigabytes = 1000 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] quota_backups = 10 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] quota_gigabytes = 1000 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] quota_groups = 10 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] quota_snapshots = 10 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] quota_volumes = 10 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] rate_limit_burst = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] rate_limit_except_level = CRITICAL {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] rate_limit_interval = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] reinit_driver_count = 3 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] replication_device = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] report_discard_supported = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] report_interval = 120 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] reservation_clean_interval = 86400 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] reservation_expire = 86400 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] reserved_image_namespaces = [] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] reserved_percentage = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] rpc_response_timeout = 120 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] run_external_periodic_tasks = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] scst_target_driver = iscsi {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] scst_target_iqn_name = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] service_down_time = 720 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] shell_completion = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] snapshot_name_template = snapshot-%s {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] snapshot_same_host = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] split_loggers = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] state_path = /opt/stack/data/cinder {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] storage_availability_zone = nova {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] storage_protocol = iSCSI {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] syslog_log_facility = LOG_USER {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] target_helper = lioadm {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] target_ip_address = 192.168.122.21 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] target_port = 3260 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] target_protocol = iscsi {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] target_secondary_ip_addresses = [] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] trace_flags = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] transport_url = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] until_refresh = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] use_chap_auth = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] use_default_quota_class = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] use_journal = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] use_json = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] use_multipath_for_image_xfer = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] use_stderr = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] use_syslog = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] verify_glance_signatures = enabled {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] volume_api_class = cinder.volume.api.API {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] volume_backend_name = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] volume_clear = zero {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] volume_clear_ionice = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] volume_clear_size = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] volume_copy_bps_limit = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] volume_dd_blocksize = 1M {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] volume_name_template = volume-%s {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] volume_service_inithost_offload = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] volume_usage_audit_period = month {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack sudo[75681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] zoning_mode = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_concurrency.disable_process_locking = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack sudo[75681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.auth_section = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.auth_type = password {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.auth_version = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.cache = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.certfile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.include_service_catalog = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.insecure = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.interface = public {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.keyfile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.memcache_password = {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.memcache_username = {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.region_name = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.service_type = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.21/identity {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.backend = dogpile.cache.null {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.backend_argument = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.backend_expiration_time = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.config_prefix = cache.oslo {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.debug_cache_backend = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.enable_retry_client = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.enable_socket_keepalive = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.enabled = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.expiration_time = 600 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.hashclient_retry_attempts = 2 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.memcache_dead_retry = 300 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.memcache_pool_maxsize = 10 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.memcache_sasl_enabled = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.password = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.proxies = [] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.redis_db = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.redis_server = localhost:6379 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.retry_attempts = 2 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.retry_delay = 0.0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.socket_keepalive_count = 1 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.socket_keepalive_idle = 1 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.socket_keepalive_interval = 1 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.socket_timeout = 1.0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.tls_allowed_ciphers = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.tls_cafile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.tls_certfile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.tls_enabled = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.tls_keyfile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cache.username = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] coordination.backend_url = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.asyncio_connection = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.asyncio_slave_connection = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.backend = sqlalchemy {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.connection = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.connection_debug = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:25 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.connection_parameters = {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.connection_recycle_time = 3600 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.connection_trace = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.db_inc_retry_interval = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.db_max_retries = 20 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.db_max_retry_interval = 10 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.db_retry_interval = 1 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.max_overflow = 50 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.max_pool_size = 5 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.max_retries = 10 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.mysql_wsrep_sync_wait = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.pool_timeout = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.retry_interval = 10 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.slave_connection = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.sqlite_synchronous = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.synchronous_reader = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] database.use_db_reconnect = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] profiler.connection_string = messaging:// {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] profiler.enabled = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] profiler.es_doc_type = notification {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] profiler.es_scroll_size = 10000 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] profiler.es_scroll_time = 2m {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] profiler.filter_error_trace = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] profiler.hmac_keys = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] profiler.sentinel_service_name = mymaster {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] profiler.socket_timeout = 0.1 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] profiler.trace_requests = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] profiler.trace_sqlalchemy = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] profiler_jaeger.process_tags = {} {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] profiler_jaeger.service_name_prefix = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] profiler_otlp.service_name_prefix = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_policy.enforce_new_defaults = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_policy.enforce_scope = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_policy.policy_default_rule = default {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_policy.policy_file = policy.yaml {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] privsep_osbrick.group = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] privsep_osbrick.helper_command = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] privsep_osbrick.user = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cinder_sys_admin.group = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cinder_sys_admin.helper_command = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] cinder_sys_admin.user = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] service_user.auth_section = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] service_user.auth_type = password {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] service_user.cafile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] service_user.certfile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] service_user.collect_timing = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] service_user.insecure = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] service_user.keyfile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] service_user.send_service_user_token = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] service_user.split_loggers = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] service_user.timeout = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] glance.auth_section = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] glance.auth_type = password {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] glance.certfile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] glance.collect_timing = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] glance.insecure = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] glance.keyfile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] glance.region_name = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] glance.split_loggers = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] glance.timeout = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.backend_availability_zone = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.chap_password = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.chap_username = {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.disk_geometry = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.driver_client_cert = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.driver_client_cert_key = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.driver_data_namespace = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.driver_use_ssl = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.extra_capabilities = {} {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.filter_function = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.goodness_function = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.iscsi_target_flags = {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.iscsi_write_cache = on {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.iser_helper = tgtadm {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.iser_ip_address = 192.168.122.21 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.iser_port = 3260 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.lvm_share_target = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.lvm_type = auto {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.num_shell_tries = 3 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.replication_device = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.report_discard_supported = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.reserved_percentage = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.target_helper = tgtadm {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.target_ip_address = 192.168.122.21 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.target_port = 3260 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.target_protocol = iscsi {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.trace_flags = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.unique_fqdn_network = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.use_chap_auth = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.volume_backend_name = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.volume_clear = zero {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.volume_clear_ionice = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.volume_clear_size = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_reports.file_event_handler = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_reports.log_dir = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.backend_host = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.chap_password = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.chap_username = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.disk_geometry = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.driver_client_cert = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.extra_capabilities = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.filter_function = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.goodness_function = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.iser_helper = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.iser_ip_address = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.iser_port = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.lvm_share_target = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.lvm_type = auto {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.num_shell_tries = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.replication_device = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.report_discard_supported = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.reserved_percentage = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.scst_target_driver = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.storage_protocol = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.target_helper = lioadm {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.target_ip_address = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.target_port = 3260 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.trace_flags = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.use_chap_auth = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.volume_clear = zero {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.volume_clear_size = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] lvmdriver-1.volumes_dir = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.ssl = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_notifications.driver = [] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_notifications.retry = -1 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] key_manager.fixed_key = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican.barbican_api_version = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican.barbican_endpoint = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican.barbican_endpoint_type = public {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican.barbican_region_name = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican.cafile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican.certfile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican.collect_timing = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican.insecure = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican.keyfile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican.number_of_retries = 60 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican.retry_delay = 1 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican.send_service_user_token = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican.split_loggers = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican.timeout = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican.verify_ssl = True {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican.verify_ssl_path = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican_service_user.auth_section = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican_service_user.auth_type = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican_service_user.cafile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican_service_user.certfile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican_service_user.collect_timing = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican_service_user.insecure = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican_service_user.keyfile = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican_service_user.split_loggers = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] barbican_service_user.timeout = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] vault.approle_role_id = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] vault.approle_secret_id = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] vault.kv_mountpoint = secret {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] vault.kv_path = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] vault.kv_version = 2 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] vault.namespace = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] vault.root_token_id = **** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] vault.ssl_ca_crt_file = None {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] vault.timeout = 60.0 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] vault.use_ssl = False {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:52:26 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] ******************************************************************************** {{(pid=75525) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 09:52:26 devstack sudo[75681]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:26 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.712s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:26 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:26 devstack sudo[75686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:52:26 devstack sudo[75686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:27 devstack sudo[75686]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:27 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.673s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:27 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 09:52:27 devstack cinder-volume[75677]: INFO cinder.brick.local_dev.lvm [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 09 09:52:27 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:27 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:27 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:27 devstack sudo[75894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 09:52:27 devstack sudo[75894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:28 devstack sudo[75894]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:28 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.676s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:28 devstack cinder-volume[75677]: DEBUG cinder.brick.local_dev.lvm [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75677) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 09 09:52:28 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:28 devstack sudo[76102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:52:28 devstack sudo[76102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:29 devstack sudo[76102]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:29 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.741s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:29 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:29 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:29 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:29 devstack sudo[76422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:52:29 devstack sudo[76422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:30 devstack sudo[76422]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:30 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.713s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:30 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:30 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:30 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:30 devstack sudo[76463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 09 09:52:30 devstack sudo[76463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:31 devstack sudo[76463]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:31 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.907s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:31 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:31 devstack sudo[76467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 09:52:31 devstack sudo[76467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:32 devstack sudo[76467]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:32 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.974s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:32 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:32 devstack sudo[76479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 09:52:32 devstack sudo[76479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:33 devstack sudo[76479]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:33 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.748s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:33 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:33 devstack sudo[76489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:52:33 devstack sudo[76489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:33 devstack sudo[76489]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:33 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.667s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:33 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:33 devstack sudo[76493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:52:33 devstack sudo[76493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:34 devstack sudo[76493]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:34 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.683s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:34 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:34 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:34 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:34 devstack sudo[76497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:52:34 devstack sudo[76497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:35 devstack sudo[76497]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:35 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.704s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:35 devstack cinder-volume[75677]: INFO cinder.volume.drivers.lvm [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 09 09:52:35 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:35 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.027s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:35 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:35 devstack sudo[76524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:52:35 devstack sudo[76524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:35 devstack cinder-volume[75525]: DEBUG dbcounter [-] [75525] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75525) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:52:35 devstack sudo[76524]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:35 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.695s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:35 devstack cinder-volume[75677]: DEBUG cinder.volume.drivers.lvm [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Updating volume stats {{(pid=75677) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 09:52:35 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:35 devstack sudo[76625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 09:52:35 devstack sudo[76625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:36 devstack sudo[76625]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:36 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.736s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:36 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:36 devstack sudo[76765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:52:36 devstack sudo[76765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:37 devstack sudo[76765]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:37 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.648s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:37 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:37 devstack sudo[76769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:52:37 devstack sudo[76769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:38 devstack sudo[76769]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:38 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.654s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:38 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:38 devstack sudo[76772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:52:38 devstack sudo[76772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:38 devstack sudo[76772]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:38 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:38 devstack cinder-volume[75677]: INFO cinder.volume.driver [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Driver hasn't implemented _init_vendor_properties() Jul 09 09:52:38 devstack cinder-volume[75677]: DEBUG cinder.volume.driver [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75677) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 09:52:38 devstack cinder-volume[75677]: DEBUG oslo_db.sqlalchemy.engines [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75677) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:52:38 devstack cinder-volume[75677]: DEBUG dbcounter [-] [75677] Writer thread running {{(pid=75677) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 09:52:38 devstack cinder-volume[75677]: DEBUG cinder.db.api [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Building query based on filter {{(pid=75677) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 09:52:38 devstack cinder-volume[75677]: DEBUG cinder.image.image_utils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75677) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 09:52:38 devstack cinder-volume[75677]: INFO cinder.keymgr.migration [None req-0f6b4b78-9fb3-4e6b-8257-acbda9a3ea06 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 09:52:38 devstack cinder-volume[75677]: DEBUG cinder.volume.drivers.lvm [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Updating volume stats {{(pid=75677) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 09:52:38 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:38 devstack sudo[76779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 09:52:38 devstack sudo[76779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:39 devstack sudo[76779]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:39 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.640s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:39 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:39 devstack sudo[76785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:52:39 devstack sudo[76785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:40 devstack sudo[76785]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:40 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.650s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:40 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:40 devstack sudo[76792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:52:40 devstack sudo[76792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:40 devstack sudo[76792]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:40 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.718s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:40 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:40 devstack sudo[76796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:52:40 devstack sudo[76796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:41 devstack sudo[76796]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:41 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:41 devstack cinder-volume[75677]: DEBUG cinder.manager [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Notifying Schedulers of capabilities ... {{(pid=75677) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:52:41 devstack cinder-volume[75677]: INFO cinder.volume.manager [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Driver initialization completed successfully. Jul 09 09:52:41 devstack cinder-volume[75677]: INFO cinder.manager [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Initiating service 2 cleanup Jul 09 09:52:41 devstack cinder-volume[75677]: INFO cinder.manager [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Service 2 cleanup completed. Jul 09 09:52:41 devstack cinder-volume[75677]: DEBUG cinder.service [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Creating RPC server for service cinder-volume {{(pid=75677) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 09:52:41 devstack cinder-volume[75677]: DEBUG cinder.service [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75677) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 09:52:41 devstack cinder-volume[75677]: INFO cinder.volume.manager [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 09 09:52:41 devstack cinder-volume[75677]: DEBUG cinder.volume.drivers.lvm [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Updating volume stats {{(pid=75677) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 09:52:41 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:41 devstack sudo[76800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 09:52:41 devstack sudo[76800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:42 devstack sudo[76800]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:42 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.708s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:42 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:42 devstack sudo[76803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:52:42 devstack sudo[76803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:43 devstack sudo[76803]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:43 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:43 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:43 devstack sudo[76863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:52:43 devstack sudo[76863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:43 devstack sudo[76863]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:43 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.629s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:43 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:52:43 devstack sudo[76866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:52:43 devstack sudo[76866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:52:44 devstack sudo[76866]: pam_unix(sudo:session): session closed for user root Jul 09 09:52:44 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.630s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:52:44 devstack cinder-volume[75677]: INFO cinder.volume.manager [None req-b9927415-986e-45cb-8063-2cab667f8d41 None None] Driver post RPC initialization completed successfully. Jul 09 09:52:54 devstack cinder-volume[75677]: DEBUG dbcounter [-] [75677] Writing DB stats cinder:SELECT=3 {{(pid=75677) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:52:54 devstack cinder-volume[75677]: DEBUG dbcounter [-] [75677] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=75677) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:53:34 devstack cinder-volume[75677]: DEBUG oslo_service.periodic_task [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75677) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:53:34 devstack cinder-volume[75677]: DEBUG cinder.volume.drivers.lvm [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Updating volume stats {{(pid=75677) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 09:53:34 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:53:34 devstack sudo[78475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 09:53:34 devstack sudo[78475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:53:34 devstack sudo[78475]: pam_unix(sudo:session): session closed for user root Jul 09 09:53:34 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.633s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:53:34 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:53:34 devstack sudo[78518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:53:34 devstack sudo[78518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:53:35 devstack sudo[78518]: pam_unix(sudo:session): session closed for user root Jul 09 09:53:35 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:53:35 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:53:35 devstack sudo[78521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:53:35 devstack sudo[78521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:53:36 devstack sudo[78521]: pam_unix(sudo:session): session closed for user root Jul 09 09:53:36 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.617s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:53:36 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:53:36 devstack sudo[78524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:53:36 devstack sudo[78524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:53:36 devstack sudo[78524]: pam_unix(sudo:session): session closed for user root Jul 09 09:53:36 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:53:36 devstack cinder-volume[75677]: DEBUG cinder.manager [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Notifying Schedulers of capabilities ... {{(pid=75677) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:53:36 devstack cinder-volume[75677]: DEBUG oslo_service.periodic_task [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running periodic task VolumeManager._thread_info {{(pid=75677) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:53:36 devstack cinder-volume[75677]: DEBUG cinder.volume.manager [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] thread count: 6 {{(pid=75677) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:53:36 devstack cinder-volume[75677]: DEBUG cinder.volume.manager [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] thread info: [<_MainThread(MainThread, started 136450570195072)>, , , , , ] {{(pid=75677) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:54:34 devstack cinder-volume[75677]: DEBUG oslo_service.periodic_task [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75677) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:54:34 devstack cinder-volume[75677]: DEBUG cinder.volume.drivers.lvm [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Updating volume stats {{(pid=75677) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 09:54:34 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:54:34 devstack sudo[81781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 09:54:34 devstack sudo[81781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:54:34 devstack sudo[81781]: pam_unix(sudo:session): session closed for user root Jul 09 09:54:34 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:54:34 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:54:34 devstack sudo[81784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:54:34 devstack sudo[81784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:54:35 devstack sudo[81784]: pam_unix(sudo:session): session closed for user root Jul 09 09:54:35 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.647s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:54:35 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:54:35 devstack sudo[81789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:54:35 devstack sudo[81789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:54:36 devstack sudo[81789]: pam_unix(sudo:session): session closed for user root Jul 09 09:54:36 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.667s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:54:36 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:54:36 devstack sudo[81809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:54:36 devstack sudo[81809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:54:36 devstack sudo[81809]: pam_unix(sudo:session): session closed for user root Jul 09 09:54:36 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:54:36 devstack cinder-volume[75677]: DEBUG cinder.manager [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Notifying Schedulers of capabilities ... {{(pid=75677) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:54:36 devstack cinder-volume[75677]: DEBUG oslo_service.periodic_task [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running periodic task VolumeManager._thread_info {{(pid=75677) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:54:36 devstack cinder-volume[75677]: DEBUG cinder.volume.manager [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] thread count: 6 {{(pid=75677) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:54:36 devstack cinder-volume[75677]: DEBUG cinder.volume.manager [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] thread info: [<_MainThread(MainThread, started 136450570195072)>, , , , , ] {{(pid=75677) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:54:54 devstack cinder-volume[75677]: DEBUG dbcounter [-] [75677] Writing DB stats cinder:SELECT=1 {{(pid=75677) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:54:54 devstack cinder-volume[75677]: DEBUG dbcounter [-] [75677] Writing DB stats cinder:UPDATE=1 {{(pid=75677) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:55:34 devstack cinder-volume[75677]: DEBUG oslo_service.periodic_task [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75677) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:55:34 devstack cinder-volume[75677]: DEBUG cinder.volume.drivers.lvm [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Updating volume stats {{(pid=75677) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 09:55:34 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:55:34 devstack sudo[84080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 09:55:34 devstack sudo[84080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:55:34 devstack sudo[84080]: pam_unix(sudo:session): session closed for user root Jul 09 09:55:34 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:55:34 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:55:34 devstack sudo[84091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:55:34 devstack sudo[84091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:55:35 devstack sudo[84091]: pam_unix(sudo:session): session closed for user root Jul 09 09:55:35 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.617s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:55:35 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:55:35 devstack sudo[84103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:55:35 devstack sudo[84103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:55:36 devstack sudo[84103]: pam_unix(sudo:session): session closed for user root Jul 09 09:55:36 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.611s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:55:36 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:55:36 devstack sudo[84130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:55:36 devstack sudo[84130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:55:36 devstack sudo[84130]: pam_unix(sudo:session): session closed for user root Jul 09 09:55:36 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.666s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:55:36 devstack cinder-volume[75677]: DEBUG cinder.manager [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Notifying Schedulers of capabilities ... {{(pid=75677) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:55:36 devstack cinder-volume[75677]: DEBUG oslo_service.periodic_task [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running periodic task VolumeManager._thread_info {{(pid=75677) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:55:36 devstack cinder-volume[75677]: DEBUG cinder.volume.manager [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] thread count: 6 {{(pid=75677) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:55:36 devstack cinder-volume[75677]: DEBUG cinder.volume.manager [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] thread info: [<_MainThread(MainThread, started 136450570195072)>, , , , , ] {{(pid=75677) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:56:34 devstack cinder-volume[75677]: DEBUG oslo_service.periodic_task [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75677) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:56:34 devstack cinder-volume[75677]: DEBUG cinder.volume.drivers.lvm [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Updating volume stats {{(pid=75677) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 09 09:56:34 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:56:34 devstack sudo[85414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 09 09:56:34 devstack sudo[85414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:56:34 devstack sudo[85414]: pam_unix(sudo:session): session closed for user root Jul 09 09:56:34 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.608s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:56:34 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:56:34 devstack sudo[85442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:56:34 devstack sudo[85442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:56:35 devstack sudo[85442]: pam_unix(sudo:session): session closed for user root Jul 09 09:56:35 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.628s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:56:35 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:56:35 devstack sudo[85525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 09 09:56:35 devstack sudo[85525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:56:36 devstack sudo[85525]: pam_unix(sudo:session): session closed for user root Jul 09 09:56:36 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.624s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:56:36 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:56:36 devstack sudo[85548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 09 09:56:36 devstack sudo[85548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:56:36 devstack sudo[85548]: pam_unix(sudo:session): session closed for user root Jul 09 09:56:36 devstack cinder-volume[75677]: DEBUG oslo_concurrency.processutils [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.604s {{(pid=75677) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:56:36 devstack cinder-volume[75677]: DEBUG cinder.manager [None req-9b04d271-f359-4f4c-8d64-6837a211fc22 None None] Notifying Schedulers of capabilities ... {{(pid=75677) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:56:54 devstack cinder-volume[75677]: DEBUG dbcounter [-] [75677] Writing DB stats cinder:SELECT=1 {{(pid=75677) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:56:54 devstack cinder-volume[75677]: DEBUG dbcounter [-] [75677] Writing DB stats cinder:UPDATE=1 {{(pid=75677) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:57:01 devstack cinder-volume[75525]: INFO oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Caught SIGTERM, stopping children Jul 09 09:57:01 devstack cinder-volume[75525]: DEBUG oslo_concurrency.lockutils [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Acquiring lock "singleton_lock" {{(pid=75525) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 09:57:01 devstack cinder-volume[75525]: DEBUG oslo_concurrency.lockutils [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Acquired lock "singleton_lock" {{(pid=75525) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 09:57:01 devstack cinder-volume[75525]: DEBUG oslo_concurrency.lockutils [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Releasing lock "singleton_lock" {{(pid=75525) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 09:57:01 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Stop services. {{(pid=75525) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 09:57:01 devstack cinder-volume[75525]: DEBUG oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Killing children. {{(pid=75525) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 09:57:01 devstack cinder-volume[75525]: INFO oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Waiting on 1 children to exit Jul 09 09:57:06 devstack cinder-volume[75677]: DEBUG oslo_concurrency.lockutils [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Acquiring lock "singleton_lock" {{(pid=75677) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 09:57:06 devstack cinder-volume[75677]: DEBUG oslo_concurrency.lockutils [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Acquired lock "singleton_lock" {{(pid=75677) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 09:57:06 devstack cinder-volume[75677]: DEBUG oslo_concurrency.lockutils [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Releasing lock "singleton_lock" {{(pid=75677) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 09:57:06 devstack cinder-volume[75677]: WARNING amqp [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 09:57:06 devstack cinder-volume[75677]: WARNING amqp [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 09:57:06 devstack cinder-volume[75525]: INFO oslo_service.backend._eventlet.service [None req-9145ea20-db75-489d-ac53-1a426a82b830 None None] Child 75677 exited with status 0 Jul 09 09:57:07 devstack cinder-volume[86199]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 09:57:07 devstack cinder-volume[86199]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 09:57:07 devstack cinder-volume[86199]: we strongly recommend against using it for new projects. Jul 09 09:57:07 devstack cinder-volume[86199]: If you are already using Eventlet, we recommend migrating to a different Jul 09 09:57:07 devstack cinder-volume[86199]: framework. For more detail see Jul 09 09:57:07 devstack cinder-volume[86199]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 09:57:07 devstack cinder-volume[86199]: import eventlet # noqa Jul 09 09:57:09 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86199) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 09:57:09 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86199) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 09:57:09 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86199) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 09:57:09 devstack cinder-volume[86199]: INFO dbcounter [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Registered counter for database cinder Jul 09 09:57:09 devstack cinder-volume[86199]: DEBUG oslo_db.sqlalchemy.engines [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86199) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:57:09 devstack cinder-volume[86199]: DEBUG dbcounter [-] [86199] Writer thread running {{(pid=86199) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 09:57:09 devstack cinder-volume[86199]: INFO cinder.rpc [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 09:57:10 devstack cinder-volume[86199]: INFO cinder.rpc [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_db.sqlalchemy.engines [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86199) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:57:10 devstack cinder-volume[86199]: INFO cinder.volume.manager [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Determined volume DB was empty at startup. Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG cinder.volume.manager [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86199) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 09:57:10 devstack cinder-volume[86199]: INFO cinder.volume.manager [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 09 09:57:10 devstack cinder-volume[86199]: WARNING stevedore.named [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 09:57:10 devstack cinder-volume[86199]: WARNING castellan.key_manager [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 09:57:10 devstack cinder-volume[86199]: WARNING cinder.keymgr.conf_key_mgr [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 09:57:10 devstack cinder-volume[86199]: INFO cinder.volume.manager [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_db.sqlalchemy.engines [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86199) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:57:10 devstack cinder-volume[86199]: INFO oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Starting 1 workers Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Started child 86389 {{(pid=86199) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Full set of CONF: {{(pid=86199) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] ******************************************************************************** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Configuration options gathered from: {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] ================================================================================ {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] allow_availability_zone_fallback = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86389]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] allow_compression_on_image_upload = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] allowed_direct_url_schemes = [] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] api_rate_limit = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] auth_strategy = keystone {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_availability_zone = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_host = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_name = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_stats_polling_interval = 60 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backup_api_class = cinder.backup.api.API {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backup_name_template = backup-%s {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backup_use_same_host = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backup_use_temp_snapshot = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] chap_password = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] chap_username = {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cinder_internal_tenant_project_id = d52db77291a5430a984c02b9984198cf {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cinder_internal_tenant_user_id = b37089c2c76a4fd2854373cab427d743 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cluster = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] compression_format = gzip {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] compute_api_class = cinder.compute.nova.API {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] config_dir = [] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] config_source = [] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] control_exchange = openstack {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] debug = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] default_availability_zone = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] default_group_type = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] default_volume_type = QuobyteHD {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] disk_geometry = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] driver_client_cert = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] driver_client_cert_key = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] driver_data_namespace = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] driver_ssl_cert_path = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] driver_ssl_cert_verify = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] driver_use_ssl = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] enable_new_services = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] enable_unsupported_driver = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] enabled_backends = ['QuobyteHD'] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] enforce_multipath_for_image_xfer = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] filter_function = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] glance_api_insecure = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] glance_api_servers = ['http://192.168.122.21/image'] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] glance_api_ssl_compression = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] glance_ca_certificates_file = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] glance_catalog_info = image:glance:publicURL {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] glance_certfile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] glance_keyfile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] glance_num_retries = 3 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] glance_request_timeout = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] goodness_function = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] graceful_shutdown_timeout = 5 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] group_api_class = cinder.group.api.API {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] host = devstack {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] image_compress_on_upload = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] image_conversion_address_space_limit = 1 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] image_conversion_cpu_limit = 60 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] image_conversion_disable = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] image_upload_use_cinder_backend = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] image_upload_use_internal_tenant = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] image_volume_cache_enabled = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] image_volume_cache_max_count = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] image_volume_cache_max_size_gb = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] init_host_max_objects_retrieval = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] instance_format = [instance: %(uuid)s] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] iscsi_target_flags = {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] iscsi_write_cache = on {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] iser_helper = tgtadm {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] iser_ip_address = 192.168.122.21 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] iser_port = 3260 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] log_color = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] log_config_append = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] log_dir = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] log_file = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] log_options = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] log_rotate_interval = 1 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] log_rotate_interval_type = days {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] log_rotation_type = none {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] max_age = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] max_logfile_count = 30 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] max_logfile_size_mb = 200 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] max_over_subscription_ratio = 20.0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] message_reap_interval = 86400 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] message_ttl = 2592000 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] migration_create_volume_timeout_secs = 300 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] monkey_patch = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] monkey_patch_modules = [] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] my_ip = 192.168.122.21 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] no_snapshot_gb_quota = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] num_iser_scan_tries = 3 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] num_shell_tries = 3 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] num_volume_device_scan_tries = 3 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] nvmeof_conn_info_version = 1 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] nvmet_ns_id = 10 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] nvmet_port_id = 1 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] osapi_max_limit = 1000 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] osapi_volume_ext_list = [] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] osapi_volume_listen_port = 8776 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] osapi_volume_use_ssl = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] osapi_volume_workers = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] per_volume_size_limit = -1 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] periodic_fuzzy_delay = 60 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] periodic_interval = 60 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] public_endpoint = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] publish_errors = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] quota_backup_gigabytes = 1000 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] quota_backups = 10 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 09:57:10 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.remotefs [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86389) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] quota_gigabytes = 1000 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] quota_groups = 10 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] quota_snapshots = 10 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] quota_volumes = 10 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] rate_limit_burst = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] rate_limit_except_level = CRITICAL {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] rate_limit_interval = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] reinit_driver_count = 3 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] replication_device = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] report_discard_supported = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] report_interval = 120 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] reservation_clean_interval = 86400 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] reservation_expire = 86400 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] reserved_image_namespaces = [] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] reserved_percentage = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] rpc_response_timeout = 120 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] run_external_periodic_tasks = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] scst_target_driver = iscsi {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] scst_target_iqn_name = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] service_down_time = 720 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] shell_completion = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] snapshot_name_template = snapshot-%s {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] split_loggers = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] state_path = /opt/stack/data/cinder {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] storage_availability_zone = nova {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] storage_protocol = iSCSI {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] syslog_log_facility = LOG_USER {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] target_helper = lioadm {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] target_ip_address = 192.168.122.21 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] target_port = 3260 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] target_protocol = iscsi {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] target_secondary_ip_addresses = [] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] trace_flags = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] transport_url = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] until_refresh = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] use_chap_auth = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] use_default_quota_class = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] use_journal = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] use_json = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] use_multipath_for_image_xfer = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] use_stderr = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] use_syslog = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] verify_glance_signatures = enabled {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] volume_api_class = cinder.volume.api.API {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] volume_backend_name = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] volume_clear = zero {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] volume_clear_ionice = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] volume_clear_size = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] volume_copy_bps_limit = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] volume_dd_blocksize = 1M {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] volume_name_template = volume-%s {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] volume_service_inithost_offload = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] volume_usage_audit_period = month {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] zoning_mode = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_concurrency.disable_process_locking = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.auth_section = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.auth_type = password {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.auth_version = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.cache = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.certfile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.include_service_catalog = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.insecure = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.interface = public {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.keyfile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.memcache_password = {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86389) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 09:57:10 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.quobyte [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86389]: WARNING cinder.volume.drivers.quobyte [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.memcache_username = {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Running cmd (subprocess): mount.quobyte {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.region_name = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.service_type = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.21/identity {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.backend = dogpile.cache.null {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.backend_argument = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.backend_expiration_time = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.config_prefix = cache.oslo {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.debug_cache_backend = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.enable_retry_client = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.enable_socket_keepalive = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.enabled = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.expiration_time = 600 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.hashclient_retry_attempts = 2 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.memcache_dead_retry = 300 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.memcache_pool_maxsize = 10 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.memcache_sasl_enabled = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.password = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.proxies = [] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.redis_db = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.redis_server = localhost:6379 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.retry_attempts = 2 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.retry_delay = 0.0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.socket_keepalive_count = 1 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.socket_keepalive_idle = 1 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.socket_keepalive_interval = 1 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.socket_timeout = 1.0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.tls_allowed_ciphers = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.tls_cafile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.tls_certfile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.tls_enabled = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.tls_keyfile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cache.username = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] coordination.backend_url = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.asyncio_connection = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.asyncio_slave_connection = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.backend = sqlalchemy {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.connection = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.connection_debug = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.connection_parameters = {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.connection_recycle_time = 3600 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.connection_trace = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.db_inc_retry_interval = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.db_max_retries = 20 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.db_max_retry_interval = 10 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.db_retry_interval = 1 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.max_overflow = 50 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.max_pool_size = 5 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.max_retries = 10 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.mysql_wsrep_sync_wait = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.pool_timeout = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.retry_interval = 10 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.slave_connection = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.sqlite_synchronous = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.synchronous_reader = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] database.use_db_reconnect = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] profiler.connection_string = messaging:// {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] profiler.enabled = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] profiler.es_doc_type = notification {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] profiler.es_scroll_size = 10000 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] profiler.es_scroll_time = 2m {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] profiler.filter_error_trace = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] profiler.hmac_keys = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] profiler.sentinel_service_name = mymaster {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] profiler.socket_timeout = 0.1 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] profiler.trace_requests = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] profiler.trace_sqlalchemy = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] profiler_jaeger.process_tags = {} {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] profiler_jaeger.service_name_prefix = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] profiler_otlp.service_name_prefix = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_policy.enforce_new_defaults = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_policy.enforce_scope = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_policy.policy_default_rule = default {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_policy.policy_file = policy.yaml {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] privsep_osbrick.group = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] privsep_osbrick.helper_command = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] privsep_osbrick.user = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cinder_sys_admin.group = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cinder_sys_admin.helper_command = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] cinder_sys_admin.user = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] service_user.auth_section = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] service_user.auth_type = password {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] service_user.cafile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] service_user.certfile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] service_user.collect_timing = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] service_user.insecure = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] service_user.keyfile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] service_user.send_service_user_token = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] service_user.split_loggers = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] service_user.timeout = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] glance.auth_section = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] glance.auth_type = password {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] glance.certfile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] glance.collect_timing = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] glance.insecure = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] glance.keyfile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] glance.region_name = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] glance.split_loggers = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] glance.timeout = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.backend_availability_zone = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.chap_password = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.chap_username = {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.disk_geometry = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.driver_client_cert = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.driver_client_cert_key = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.driver_data_namespace = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.driver_use_ssl = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.extra_capabilities = {} {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.filter_function = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.goodness_function = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.iscsi_target_flags = {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.iscsi_write_cache = on {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.iser_helper = tgtadm {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.iser_ip_address = 192.168.122.21 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.iser_port = 3260 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.nas_host = {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.nas_login = admin {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.nas_mount_options = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.nas_password = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.nas_private_key = {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.nas_share_path = {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack quobyte-client[86418]: Reading configuration file: /etc/quobyte/client.cfg Jul 09 09:57:10 devstack quobyte-client[86418]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.num_shell_tries = 3 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] CMD "mount.quobyte" returned: 1 in 0.111s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.quobyte_volume_url = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.replication_device = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.report_discard_supported = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.reserved_percentage = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.target_helper = tgtadm {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.target_ip_address = 192.168.122.21 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.target_port = 3260 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.target_protocol = iscsi {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.trace_flags = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.unique_fqdn_network = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86389]: INFO cinder.volume.drivers.quobyte [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 ... Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.use_chap_auth = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 -c /etc/quobyte/client-cinder.cfg {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.volume_backend_name = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.volume_clear = zero {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.volume_clear_ionice = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.volume_clear_size = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_reports.file_event_handler = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_reports.log_dir = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.backend_availability_zone = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.backend_host = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.chap_password = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.chap_username = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.chiscsi_conf = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.disk_geometry = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.driver_client_cert = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.driver_data_namespace = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.driver_use_ssl = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.extra_capabilities = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.filter_function = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.goodness_function = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.iser_helper = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.iser_ip_address = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.iser_port = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.iser_target_prefix = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.nas_host = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.nas_login = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.nas_mount_options = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.nas_password = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.nas_private_key = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.nas_share_path = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.nas_ssh_port = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.num_shell_tries = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.nvmet_port_id = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.replication_device = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.report_discard_supported = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.reserved_percentage = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.scst_target_driver = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.storage_protocol = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.target_helper = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.target_ip_address = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.target_port = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.target_prefix = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.target_protocol = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.trace_flags = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.use_chap_auth = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.volume_clear = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.volume_clear_size = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack sudo[86419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 -c /etc/quobyte/client-cinder.cfg Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] QuobyteHD.volumes_dir = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack sudo[86419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.ssl = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_notifications.driver = [] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_notifications.retry = -1 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] key_manager.fixed_key = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican.barbican_api_version = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican.barbican_endpoint = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican.barbican_endpoint_type = public {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican.barbican_region_name = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican.cafile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican.certfile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican.collect_timing = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican.insecure = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican.keyfile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican.number_of_retries = 60 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican.retry_delay = 1 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican.send_service_user_token = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican.split_loggers = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican.timeout = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican.verify_ssl = True {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican.verify_ssl_path = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican_service_user.auth_section = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican_service_user.auth_type = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican_service_user.cafile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican_service_user.certfile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican_service_user.collect_timing = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican_service_user.insecure = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican_service_user.keyfile = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican_service_user.split_loggers = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] barbican_service_user.timeout = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] vault.approle_role_id = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] vault.approle_secret_id = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] vault.kv_mountpoint = secret {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] vault.kv_path = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] vault.kv_version = 2 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] vault.namespace = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] vault.root_token_id = **** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] vault.ssl_ca_crt_file = None {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] vault.timeout = 60.0 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] vault.use_ssl = False {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:10 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] ******************************************************************************** {{(pid=86199) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 09:57:11 devstack sudo[86419]: pam_unix(sudo:session): session closed for user root Jul 09 09:57:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.809s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:57:11 devstack cinder-volume[86389]: INFO cinder.volume.drivers.quobyte [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 succeeded Jul 09 09:57:11 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:57:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.824s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:57:11 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:57:11 devstack sudo[86492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 09:57:11 devstack sudo[86492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:57:12 devstack sudo[86492]: pam_unix(sudo:session): session closed for user root Jul 09 09:57:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.676s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:57:12 devstack cinder-volume[86389]: INFO cinder.volume.driver [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Driver hasn't implemented _init_vendor_properties() Jul 09 09:57:12 devstack cinder-volume[86389]: DEBUG cinder.volume.driver [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86389) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 09:57:12 devstack cinder-volume[86389]: DEBUG oslo_db.sqlalchemy.engines [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86389) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:57:12 devstack cinder-volume[86389]: DEBUG dbcounter [-] [86389] Writer thread running {{(pid=86389) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 09:57:12 devstack cinder-volume[86389]: DEBUG cinder.db.api [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Building query based on filter {{(pid=86389) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 09:57:12 devstack cinder-volume[86389]: DEBUG cinder.image.image_utils [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86389) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 09:57:12 devstack cinder-volume[86389]: INFO cinder.keymgr.migration [None req-038da9da-b3fa-4bda-8058-ad40224628ec None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 09:57:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:57:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:57:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:57:12 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:57:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:57:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:57:12 devstack sudo[86498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 09:57:12 devstack sudo[86498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:57:12 devstack sudo[86498]: pam_unix(sudo:session): session closed for user root Jul 09 09:57:12 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.621s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:57:12 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:57:12 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Driver initialization completed successfully. Jul 09 09:57:12 devstack cinder-volume[86389]: INFO cinder.manager [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Initiating service 3 cleanup Jul 09 09:57:12 devstack cinder-volume[86389]: INFO cinder.manager [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Service 3 cleanup completed. Jul 09 09:57:12 devstack cinder-volume[86389]: DEBUG cinder.service [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Creating RPC server for service cinder-volume {{(pid=86389) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 09:57:12 devstack cinder-volume[86389]: DEBUG cinder.service [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86389) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 09:57:13 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 09:57:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:57:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:57:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:57:13 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:57:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:57:13 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:57:13 devstack sudo[86521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 09:57:13 devstack sudo[86521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:57:14 devstack sudo[86521]: pam_unix(sudo:session): session closed for user root Jul 09 09:57:14 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.084s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:57:14 devstack cinder-volume[86389]: INFO cinder.volume.manager [None req-e4cd24c1-a722-4cc5-b1da-9932677d1f40 None None] Driver post RPC initialization completed successfully. Jul 09 09:57:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0b823c0e-53e5-4a9c-a0fa-791d9fc42eaa None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:57:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0b823c0e-53e5-4a9c-a0fa-791d9fc42eaa None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:57:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0b823c0e-53e5-4a9c-a0fa-791d9fc42eaa None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=86389) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:57:17 devstack cinder-volume[86389]: DEBUG cinder.volume.drivers.quobyte [None req-0b823c0e-53e5-4a9c-a0fa-791d9fc42eaa None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=86389) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:57:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-0b823c0e-53e5-4a9c-a0fa-791d9fc42eaa None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86389) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:57:17 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0b823c0e-53e5-4a9c-a0fa-791d9fc42eaa None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:57:17 devstack sudo[86739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 09:57:17 devstack sudo[86739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:57:18 devstack sudo[86739]: pam_unix(sudo:session): session closed for user root Jul 09 09:57:18 devstack cinder-volume[86389]: DEBUG oslo_concurrency.processutils [None req-0b823c0e-53e5-4a9c-a0fa-791d9fc42eaa None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.639s {{(pid=86389) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:57:18 devstack cinder-volume[86389]: DEBUG cinder.manager [None req-0b823c0e-53e5-4a9c-a0fa-791d9fc42eaa None None] Notifying Schedulers of capabilities ... {{(pid=86389) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:57:19 devstack cinder-volume[86199]: INFO oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Caught SIGTERM, stopping children Jul 09 09:57:19 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Acquiring lock "singleton_lock" {{(pid=86199) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 09:57:19 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Acquired lock "singleton_lock" {{(pid=86199) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 09:57:19 devstack cinder-volume[86199]: DEBUG oslo_concurrency.lockutils [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Releasing lock "singleton_lock" {{(pid=86199) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 09:57:19 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Stop services. {{(pid=86199) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 09 09:57:19 devstack cinder-volume[86199]: DEBUG oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Killing children. {{(pid=86199) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 09 09:57:19 devstack cinder-volume[86199]: INFO oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Waiting on 1 children to exit Jul 09 09:57:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Acquiring lock "singleton_lock" {{(pid=86389) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 09:57:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Acquired lock "singleton_lock" {{(pid=86389) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 09:57:21 devstack cinder-volume[86389]: DEBUG oslo_concurrency.lockutils [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Releasing lock "singleton_lock" {{(pid=86389) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 09:57:21 devstack cinder-volume[86389]: WARNING amqp [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 09:57:21 devstack cinder-volume[86389]: WARNING amqp [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 09 09:57:21 devstack cinder-volume[86199]: INFO oslo_service.backend._eventlet.service [None req-04f53e46-b1f1-4d12-b95d-63417bbbf418 None None] Child 86389 exited with status 0 Jul 09 09:57:22 devstack cinder-volume[86880]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 09 09:57:22 devstack cinder-volume[86880]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 09:57:22 devstack cinder-volume[86880]: we strongly recommend against using it for new projects. Jul 09 09:57:22 devstack cinder-volume[86880]: If you are already using Eventlet, we recommend migrating to a different Jul 09 09:57:22 devstack cinder-volume[86880]: framework. For more detail see Jul 09 09:57:22 devstack cinder-volume[86880]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 09:57:22 devstack cinder-volume[86880]: import eventlet # noqa Jul 09 09:57:25 devstack cinder-volume[86880]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86880) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 09 09:57:25 devstack cinder-volume[86880]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86880) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 09 09:57:25 devstack cinder-volume[86880]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86880) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 09 09:57:26 devstack cinder-volume[86880]: INFO dbcounter [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] Registered counter for database cinder Jul 09 09:57:26 devstack cinder-volume[86880]: DEBUG oslo_db.sqlalchemy.engines [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86880) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:57:26 devstack cinder-volume[86880]: DEBUG dbcounter [-] [86880] Writer thread running {{(pid=86880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 09:57:26 devstack cinder-volume[86880]: INFO cinder.rpc [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 09 09:57:26 devstack cinder-volume[86880]: INFO cinder.rpc [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_db.sqlalchemy.engines [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86880) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:57:27 devstack cinder-volume[86880]: INFO cinder.volume.manager [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] Determined volume DB was empty at startup. Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG cinder.volume.manager [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86880) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 09 09:57:27 devstack cinder-volume[86880]: WARNING stevedore.named [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 09 09:57:27 devstack cinder-volume[86880]: WARNING castellan.key_manager [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 09:57:27 devstack cinder-volume[86880]: WARNING cinder.keymgr.conf_key_mgr [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 09 09:57:27 devstack cinder-volume[86880]: INFO cinder.volume.manager [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_db.sqlalchemy.engines [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86880) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:57:27 devstack cinder-volume[86880]: INFO oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] Starting 1 workers Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] Started child 87192 {{(pid=86880) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] Full set of CONF: {{(pid=86880) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] ******************************************************************************** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] Configuration options gathered from: {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] ================================================================================ {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] allow_availability_zone_fallback = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] allow_compression_on_image_upload = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] allowed_direct_url_schemes = [] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] api_rate_limit = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] auth_strategy = keystone {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_availability_zone = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_host = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_name = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_stats_polling_interval = 60 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backup_api_class = cinder.backup.api.API {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backup_name_template = backup-%s {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backup_use_same_host = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backup_use_temp_snapshot = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] chap_password = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] chap_username = {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[87192]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cinder_internal_tenant_project_id = d52db77291a5430a984c02b9984198cf {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cinder_internal_tenant_user_id = b37089c2c76a4fd2854373cab427d743 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cluster = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] compression_format = gzip {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] compute_api_class = cinder.compute.nova.API {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] config_dir = [] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] config_source = [] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] control_exchange = openstack {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] debug = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] default_availability_zone = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] default_group_type = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] default_volume_type = QuobyteHD {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] disk_geometry = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] driver_client_cert = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] driver_client_cert_key = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] driver_data_namespace = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] driver_ssl_cert_path = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] driver_ssl_cert_verify = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] driver_use_ssl = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] enable_new_services = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] enable_unsupported_driver = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] enabled_backends = ['QuobyteHD'] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] enforce_multipath_for_image_xfer = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] filter_function = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] glance_api_insecure = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] glance_api_servers = ['http://192.168.122.21/image'] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] glance_api_ssl_compression = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] glance_ca_certificates_file = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] glance_catalog_info = image:glance:publicURL {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] glance_certfile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] glance_keyfile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] glance_num_retries = 3 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] glance_request_timeout = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] goodness_function = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] graceful_shutdown_timeout = 5 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] group_api_class = cinder.group.api.API {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] host = devstack {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] image_compress_on_upload = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] image_conversion_address_space_limit = 1 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] image_conversion_cpu_limit = 60 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] image_conversion_disable = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] image_upload_use_cinder_backend = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] image_upload_use_internal_tenant = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] image_volume_cache_enabled = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] image_volume_cache_max_count = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] image_volume_cache_max_size_gb = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] init_host_max_objects_retrieval = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] instance_format = [instance: %(uuid)s] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] iscsi_target_flags = {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] iscsi_write_cache = on {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] iser_helper = tgtadm {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] iser_ip_address = 192.168.122.21 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] iser_port = 3260 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] log_color = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] log_config_append = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] log_dir = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] log_file = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] log_options = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] log_rotate_interval = 1 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] log_rotate_interval_type = days {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] log_rotation_type = none {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] max_age = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] max_logfile_count = 30 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] max_logfile_size_mb = 200 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] max_over_subscription_ratio = 20.0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] message_reap_interval = 86400 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] message_ttl = 2592000 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] migration_create_volume_timeout_secs = 300 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] monkey_patch = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] monkey_patch_modules = [] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] my_ip = 192.168.122.21 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] no_snapshot_gb_quota = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] num_iser_scan_tries = 3 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] num_shell_tries = 3 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] num_volume_device_scan_tries = 3 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] nvmeof_conn_info_version = 1 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] nvmet_ns_id = 10 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] nvmet_port_id = 1 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] osapi_max_limit = 1000 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] osapi_volume_ext_list = [] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] osapi_volume_listen_port = 8776 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] osapi_volume_use_ssl = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] osapi_volume_workers = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] per_volume_size_limit = -1 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] periodic_fuzzy_delay = 60 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] periodic_interval = 60 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] public_endpoint = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] publish_errors = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] quota_backup_gigabytes = 1000 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] quota_backups = 10 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] quota_gigabytes = 1000 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] quota_groups = 10 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] quota_snapshots = 10 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] quota_volumes = 10 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87192) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] rate_limit_burst = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] rate_limit_except_level = CRITICAL {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] rate_limit_interval = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] reinit_driver_count = 3 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] replication_device = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] report_discard_supported = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] report_interval = 120 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] reservation_clean_interval = 86400 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] reservation_expire = 86400 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] reserved_image_namespaces = [] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] reserved_percentage = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] rpc_response_timeout = 120 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] run_external_periodic_tasks = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] scst_target_driver = iscsi {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] scst_target_iqn_name = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] service_down_time = 720 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] shell_completion = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] snapshot_name_template = snapshot-%s {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] split_loggers = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] state_path = /opt/stack/data/cinder {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] storage_availability_zone = nova {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] storage_protocol = iSCSI {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] syslog_log_facility = LOG_USER {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] target_helper = lioadm {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] target_ip_address = 192.168.122.21 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] target_port = 3260 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] target_protocol = iscsi {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] target_secondary_ip_addresses = [] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] trace_flags = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] transport_url = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] until_refresh = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] use_chap_auth = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] use_default_quota_class = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] use_journal = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] use_json = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] use_multipath_for_image_xfer = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] use_stderr = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] use_syslog = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] verify_glance_signatures = enabled {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] volume_api_class = cinder.volume.api.API {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] volume_backend_name = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] volume_clear = zero {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] volume_clear_ionice = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] volume_clear_size = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] volume_copy_bps_limit = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] volume_dd_blocksize = 1M {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] volume_name_template = volume-%s {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] volume_service_inithost_offload = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] volume_usage_audit_period = month {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] zoning_mode = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_concurrency.disable_process_locking = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.auth_section = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.auth_type = password {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.auth_version = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.cache = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.certfile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.include_service_catalog = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.insecure = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.interface = public {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.keyfile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.memcache_password = {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.memcache_username = {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.region_name = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.service_type = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.21/identity {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.backend = dogpile.cache.null {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.backend_argument = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.backend_expiration_time = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.config_prefix = cache.oslo {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.debug_cache_backend = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.enable_retry_client = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.enable_socket_keepalive = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.enabled = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.expiration_time = 600 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.hashclient_retry_attempts = 2 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.memcache_dead_retry = 300 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.memcache_pool_maxsize = 10 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.memcache_sasl_enabled = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.password = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.proxies = [] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.redis_db = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.redis_server = localhost:6379 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.retry_attempts = 2 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.retry_delay = 0.0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.socket_keepalive_count = 1 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.socket_keepalive_idle = 1 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.socket_keepalive_interval = 1 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.socket_timeout = 1.0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.tls_allowed_ciphers = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.tls_cafile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.tls_certfile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.tls_enabled = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.tls_keyfile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cache.username = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] coordination.backend_url = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.asyncio_connection = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.asyncio_slave_connection = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.backend = sqlalchemy {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.connection = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.connection_debug = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.connection_parameters = {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.connection_recycle_time = 3600 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.connection_trace = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.db_inc_retry_interval = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.db_max_retries = 20 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.db_max_retry_interval = 10 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.db_retry_interval = 1 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.max_overflow = 50 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.max_pool_size = 5 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.max_retries = 10 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.mysql_wsrep_sync_wait = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.pool_timeout = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.retry_interval = 10 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.slave_connection = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.sqlite_synchronous = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.synchronous_reader = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] database.use_db_reconnect = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] profiler.connection_string = messaging:// {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] profiler.enabled = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] profiler.es_doc_type = notification {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] profiler.es_scroll_size = 10000 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] profiler.es_scroll_time = 2m {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] profiler.filter_error_trace = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] profiler.hmac_keys = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] profiler.sentinel_service_name = mymaster {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] profiler.socket_timeout = 0.1 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] profiler.trace_requests = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] profiler.trace_sqlalchemy = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] profiler_jaeger.process_tags = {} {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] profiler_jaeger.service_name_prefix = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] profiler_otlp.service_name_prefix = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_policy.enforce_new_defaults = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_policy.enforce_scope = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_policy.policy_default_rule = default {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_policy.policy_file = policy.yaml {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] privsep_osbrick.group = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] privsep_osbrick.helper_command = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] privsep_osbrick.user = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cinder_sys_admin.group = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cinder_sys_admin.helper_command = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87192) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] cinder_sys_admin.user = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.quobyte [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] service_user.auth_section = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] service_user.auth_type = password {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] service_user.cafile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] service_user.certfile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] service_user.collect_timing = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] service_user.insecure = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.quobyte [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] service_user.keyfile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] service_user.send_service_user_token = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] service_user.split_loggers = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] service_user.timeout = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] glance.auth_section = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Running cmd (subprocess): mount.quobyte {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] glance.auth_type = password {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] glance.certfile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] glance.collect_timing = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] glance.insecure = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] glance.keyfile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] glance.region_name = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] glance.split_loggers = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] glance.timeout = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.backend_availability_zone = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.chap_password = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.chap_username = {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.disk_geometry = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.driver_client_cert = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.driver_client_cert_key = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.driver_data_namespace = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.driver_use_ssl = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.extra_capabilities = {} {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.filter_function = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.goodness_function = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.iscsi_target_flags = {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.iscsi_write_cache = on {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.iser_helper = tgtadm {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.iser_ip_address = 192.168.122.21 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.iser_port = 3260 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.nas_host = {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.nas_login = admin {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.nas_mount_options = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.nas_password = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.nas_private_key = {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.nas_share_path = {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.num_shell_tries = 3 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.quobyte_volume_url = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.replication_device = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.report_discard_supported = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.reserved_percentage = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.target_helper = tgtadm {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.target_ip_address = 192.168.122.21 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.target_port = 3260 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.target_protocol = iscsi {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.trace_flags = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.unique_fqdn_network = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.use_chap_auth = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.volume_backend_name = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.volume_clear = zero {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.volume_clear_ionice = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.volume_clear_size = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_reports.file_event_handler = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_reports.log_dir = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.backend_availability_zone = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.backend_host = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.chap_password = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.chap_username = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.chiscsi_conf = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.disk_geometry = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.driver_client_cert = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.driver_data_namespace = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.driver_use_ssl = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.extra_capabilities = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.filter_function = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.goodness_function = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.iser_helper = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.iser_ip_address = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.iser_port = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.iser_target_prefix = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.nas_host = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.nas_login = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.nas_mount_options = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.nas_password = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.nas_private_key = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.nas_share_path = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.nas_ssh_port = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.num_shell_tries = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.nvmet_port_id = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.replication_device = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.report_discard_supported = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.reserved_percentage = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.scst_target_driver = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.storage_protocol = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.target_helper = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.target_ip_address = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.target_port = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.target_prefix = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.target_protocol = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.trace_flags = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack quobyte-client[87193]: Reading configuration file: /etc/quobyte/client.cfg Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.use_chap_auth = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack quobyte-client[87193]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.volume_clear = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.volume_clear_size = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] CMD "mount.quobyte" returned: 1 in 0.061s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] QuobyteHD.volumes_dir = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.ssl = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_notifications.driver = [] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_notifications.retry = -1 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] key_manager.fixed_key = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican.barbican_api_version = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican.barbican_endpoint = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican.barbican_endpoint_type = public {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican.barbican_region_name = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican.cafile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican.certfile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican.collect_timing = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican.insecure = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican.keyfile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican.number_of_retries = 60 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican.retry_delay = 1 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican.send_service_user_token = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican.split_loggers = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican.timeout = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican.verify_ssl = True {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican.verify_ssl_path = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican_service_user.auth_section = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican_service_user.auth_type = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican_service_user.cafile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican_service_user.certfile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican_service_user.collect_timing = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican_service_user.insecure = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican_service_user.keyfile = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican_service_user.split_loggers = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] barbican_service_user.timeout = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] vault.approle_role_id = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] vault.approle_secret_id = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] vault.kv_mountpoint = secret {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] vault.kv_path = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] vault.kv_version = 2 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] vault.namespace = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] vault.root_token_id = **** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] vault.ssl_ca_crt_file = None {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] vault.timeout = 60.0 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] vault.use_ssl = False {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 09 09:57:27 devstack cinder-volume[86880]: DEBUG oslo_service.backend._eventlet.service [None req-097d1f89-e4d6-436d-897e-a604d4084506 None None] ******************************************************************************** {{(pid=86880) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 09 09:57:27 devstack sudo[87194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 09:57:27 devstack sudo[87194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:57:28 devstack sudo[87194]: pam_unix(sudo:session): session closed for user root Jul 09 09:57:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.617s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:57:28 devstack cinder-volume[87192]: INFO cinder.volume.driver [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Driver hasn't implemented _init_vendor_properties() Jul 09 09:57:28 devstack cinder-volume[87192]: DEBUG cinder.volume.driver [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87192) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 09 09:57:28 devstack cinder-volume[87192]: DEBUG oslo_db.sqlalchemy.engines [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87192) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 09 09:57:28 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writer thread running {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 09 09:57:28 devstack cinder-volume[87192]: DEBUG cinder.db.api [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Building query based on filter {{(pid=87192) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 09 09:57:28 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87192) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 09 09:57:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:57:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:57:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:57:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:57:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:57:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:57:28 devstack cinder-volume[87192]: INFO cinder.keymgr.migration [None req-e68fa132-d693-46be-96e4-8db8662438a2 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 09 09:57:28 devstack sudo[87199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 09:57:28 devstack sudo[87199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:57:28 devstack sudo[87199]: pam_unix(sudo:session): session closed for user root Jul 09 09:57:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.619s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:57:28 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:57:28 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Driver initialization completed successfully. Jul 09 09:57:28 devstack cinder-volume[87192]: INFO cinder.manager [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Initiating service 3 cleanup Jul 09 09:57:28 devstack cinder-volume[87192]: INFO cinder.manager [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Service 3 cleanup completed. Jul 09 09:57:28 devstack cinder-volume[87192]: DEBUG cinder.service [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Creating RPC server for service cinder-volume {{(pid=87192) start /opt/stack/cinder/cinder/service.py:231}} Jul 09 09:57:28 devstack cinder-volume[87192]: DEBUG cinder.service [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87192) start /opt/stack/cinder/cinder/service.py:237}} Jul 09 09:57:29 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 09 09:57:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:57:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:57:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:57:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:57:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:57:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:57:29 devstack sudo[87203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 09:57:29 devstack sudo[87203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:57:29 devstack sudo[87203]: pam_unix(sudo:session): session closed for user root Jul 09 09:57:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.650s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:57:29 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2ffccf49-a686-4866-83a0-518eb65b9e09 None None] Driver post RPC initialization completed successfully. Jul 09 09:57:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:57:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 6 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:57:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:57:37 devstack cinder-volume[86880]: DEBUG dbcounter [-] [86880] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86880) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:57:38 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=8,cinder:UPDATE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:57:39 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=2 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:58:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:58:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:58:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:58:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:58:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:58:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:58:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:58:29 devstack sudo[87563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 09:58:29 devstack sudo[87563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:58:30 devstack sudo[87563]: pam_unix(sudo:session): session closed for user root Jul 09 09:58:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.766s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:58:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:58:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:58:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 6 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 09:58:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Flow 'volume_create_manager' (2409326b-0c81-4ca9-8fbc-efeda88d174a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae025cc-74b2-45ef-ad15-fc47348eeaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bae025cc-74b2-45ef-ad15-fc47348eeaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2067690415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea05f193-9a72-4065-89a3-4a92dae4142e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='568904d720854dedaa8e06e2bfa48c2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:58:54Z,use_quota=True,user_id='0ed1f170774a44c1a286f8426f7759bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e3c2d1-f7a9-41d6-9508-e3aed0d762c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59e3c2d1-f7a9-41d6-9508-e3aed0d762c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac787ebc-95e8-4bf4-86f9-546dcaf65c72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac787ebc-95e8-4bf4-86f9-546dcaf65c72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea05f193-9a72-4065-89a3-4a92dae4142e', 'volume_name': 'volume-ea05f193-9a72-4065-89a3-4a92dae4142e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a217623-a031-4765-bd54-1f8e692c29a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a217623-a031-4765-bd54-1f8e692c29a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf1a5ff-ba03-4dd2-94ce-f02a0e47cbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:58:54 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Volume ea05f193-9a72-4065-89a3-4a92dae4142e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea05f193-9a72-4065-89a3-4a92dae4142e', 'volume_size': 1} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:58:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2067690415',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea05f193-9a72-4065-89a3-4a92dae4142e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='568904d720854dedaa8e06e2bfa48c2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:58:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:58:54Z,use_quota=True,user_id='0ed1f170774a44c1a286f8426f7759bf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Creating volume ea05f193-9a72-4065-89a3-4a92dae4142e {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:58:54 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 09:58:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:58:54 devstack sudo[87942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e 1073741824 Jul 09 09:58:54 devstack sudo[87942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:58:56 devstack sudo[87942]: pam_unix(sudo:session): session closed for user root Jul 09 09:58:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e 1073741824" returned: 0 in 1.893s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:58:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:58:56 devstack sudo[88266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e Jul 09 09:58:56 devstack sudo[88266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:58:58 devstack sudo[88266]: pam_unix(sudo:session): session closed for user root Jul 09 09:58:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e" returned: 0 in 1.706s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:58:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] <== create_volume: return (3719ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:58:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.722s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:58:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdf1a5ff-ba03-4dd2-94ce-f02a0e47cbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea05f193-9a72-4065-89a3-4a92dae4142e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:58:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758ab1da-8f1d-4f98-b2bf-a10b43a46cca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:58:58 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Volume volume-ea05f193-9a72-4065-89a3-4a92dae4142e (ea05f193-9a72-4065-89a3-4a92dae4142e): created successfully Jul 09 09:58:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (758ab1da-8f1d-4f98-b2bf-a10b43a46cca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:58:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Flow 'volume_create_manager' (2409326b-0c81-4ca9-8fbc-efeda88d174a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:58:58 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-11cdfdb8-e1ba-444b-8467-d926ba00648f req-cc7cc79e-16cd-445a-bff0-2ed0b3b6e86c tempest-VolumesSnapshotsTestJSON-1309255089 None] Created volume successfully. Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Flow 'volume_create_manager' (590f1943-2324-459a-bfc8-87e03134cece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de82dc7-eb6a-40a3-b05c-16b052fa6d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3de82dc7-eb6a-40a3-b05c-16b052fa6d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1386356581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c5a11c-4a45-4dc9-98e1-d2c9c010d59c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55274fd4286744ccacb8e1c512b53f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:58:59Z,use_quota=True,user_id='02dd1f85be5744d8a971b665ebf122cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf47638-e46e-4df2-954a-4fceb090140c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cf47638-e46e-4df2-954a-4fceb090140c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a8b313-dbc1-4916-bdaa-76e4d717294b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1a8b313-dbc1-4916-bdaa-76e4d717294b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42c5a11c-4a45-4dc9-98e1-d2c9c010d59c', 'volume_name': 'volume-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d94645-4765-4105-ad5f-83f8cea367fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5d94645-4765-4105-ad5f-83f8cea367fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da39c83-b82f-4b53-992b-fe26b36ba871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:58:59 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Volume 42c5a11c-4a45-4dc9-98e1-d2c9c010d59c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c', 'volume_size': 1} Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:58:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1386356581',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42c5a11c-4a45-4dc9-98e1-d2c9c010d59c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55274fd4286744ccacb8e1c512b53f9d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:58:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:58:59Z,use_quota=True,user_id='02dd1f85be5744d8a971b665ebf122cc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Creating volume 42c5a11c-4a45-4dc9-98e1-d2c9c010d59c {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:58:59 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 09:58:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:58:59 devstack sudo[88278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c 1073741824 Jul 09 09:58:59 devstack sudo[88278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Flow 'volume_create_manager' (65e09c14-4ade-4231-8101-de24a2ab6a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265e658a-8c9b-48a1-8e88-317a997d7213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265e658a-8c9b-48a1-8e88-317a997d7213) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1268689433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1aab42e-1fc1-461b-9fe7-defc4e1cc682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1767ca46a63f40d6a05d15b48e3379e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:59:00Z,use_quota=True,user_id='65e2a98c976a4c4f86d6e5eb56abb831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e451c37-ad9d-4158-96ec-f7fffe958f02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e451c37-ad9d-4158-96ec-f7fffe958f02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b4046b-464d-47ee-ba61-ceffa5fe41d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (98b4046b-464d-47ee-ba61-ceffa5fe41d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e1aab42e-1fc1-461b-9fe7-defc4e1cc682', 'volume_name': 'volume-e1aab42e-1fc1-461b-9fe7-defc4e1cc682', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567f6a77-3888-4830-b51f-7abebf1b4d91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (567f6a77-3888-4830-b51f-7abebf1b4d91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb67b99-82c4-4588-abd2-a877bb2cfebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:00 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Volume e1aab42e-1fc1-461b-9fe7-defc4e1cc682: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e1aab42e-1fc1-461b-9fe7-defc4e1cc682', 'volume_size': 1} Jul 09 09:59:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:59:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:59:01 devstack sudo[88278]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c 1073741824" returned: 0 in 2.242s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:01 devstack sudo[88285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c Jul 09 09:59:01 devstack sudo[88285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:02 devstack sudo[88285]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c" returned: 0 in 0.953s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] <== create_volume: return (3279ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:59:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.282s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:59:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.240s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:59:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:58:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1268689433',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e1aab42e-1fc1-461b-9fe7-defc4e1cc682,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1767ca46a63f40d6a05d15b48e3379e7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:59:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:59:00Z,use_quota=True,user_id='65e2a98c976a4c4f86d6e5eb56abb831',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:59:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Creating volume e1aab42e-1fc1-461b-9fe7-defc4e1cc682 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:59:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:59:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:59:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:59:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:59:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:59:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:59:02 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 09:59:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e1aab42e-1fc1-461b-9fe7-defc4e1cc682 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:02 devstack sudo[88288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e1aab42e-1fc1-461b-9fe7-defc4e1cc682 1073741824 Jul 09 09:59:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0da39c83-b82f-4b53-992b-fe26b36ba871) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:02 devstack sudo[88288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7107889-c4c6-45d6-b84d-98c0d8e9b8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:02 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Volume volume-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c (42c5a11c-4a45-4dc9-98e1-d2c9c010d59c): created successfully Jul 09 09:59:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7107889-c4c6-45d6-b84d-98c0d8e9b8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Flow 'volume_create_manager' (590f1943-2324-459a-bfc8-87e03134cece) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:59:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-58fc7e35-5106-4346-9b51-c7cfc2e8c64f tempest-ServerRescueNegativeTestJSON-134814726 None] Created volume successfully. Jul 09 09:59:04 devstack sudo[88288]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e1aab42e-1fc1-461b-9fe7-defc4e1cc682 1073741824" returned: 0 in 1.633s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e1aab42e-1fc1-461b-9fe7-defc4e1cc682 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:04 devstack sudo[88298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e1aab42e-1fc1-461b-9fe7-defc4e1cc682 Jul 09 09:59:04 devstack sudo[88298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:06 devstack sudo[88298]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e1aab42e-1fc1-461b-9fe7-defc4e1cc682" returned: 0 in 1.661s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] <== create_volume: return (3376ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:59:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.380s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:59:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.294s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8cb67b99-82c4-4588-abd2-a877bb2cfebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e1aab42e-1fc1-461b-9fe7-defc4e1cc682', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1969ff00-9f14-4028-99a2-a1b4a2163faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:06 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Volume volume-e1aab42e-1fc1-461b-9fe7-defc4e1cc682 (e1aab42e-1fc1-461b-9fe7-defc4e1cc682): created successfully Jul 09 09:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1969ff00-9f14-4028-99a2-a1b4a2163faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Flow 'volume_create_manager' (65e09c14-4ade-4231-8101-de24a2ab6a01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:59:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] Creating offline snapshot 33e60aac-f61a-479b-8337-fd841b9adf95 of volume ea05f193-9a72-4065-89a3-4a92dae4142e {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:59:06 devstack cinder-volume[87192]: INFO oslo.privsep.daemon [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp4i9b054q/privsep.sock'] Jul 09 09:59:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-645f6492-ec30-43db-bc6b-85fa9a57e3d0 tempest-VolumesAdminNegativeTest-741900234 None] Created volume successfully. Jul 09 09:59:06 devstack sudo[88306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp4i9b054q/privsep.sock Jul 09 09:59:06 devstack sudo[88306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:07 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 09 09:59:07 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 09:59:07 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 09:59:07 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 09:59:07 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 09:59:07 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 09:59:07 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 09:59:07 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 09:59:07 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 09 09:59:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] Acquiring lock "cinder-e1aab42e-1fc1-461b-9fe7-defc4e1cc682-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:59:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] Lock "cinder-e1aab42e-1fc1-461b-9fe7-defc4e1cc682-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:59:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] Acquiring lock "cinder-quobyte-e1aab42e-1fc1-461b-9fe7-defc4e1cc682" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:59:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] Lock "cinder-quobyte-e1aab42e-1fc1-461b-9fe7-defc4e1cc682" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:59:09 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 09 09:59:09 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 09 09:59:09 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 09 09:59:09 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 09:59:09 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 09 09:59:09 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 09 09:59:09 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 09 09:59:09 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: Jul 09 09:59:09 devstack cinder-volume[87192]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 09 09:59:09 devstack sudo[88306]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:09 devstack cinder-volume[87192]: INFO oslo.privsep.daemon [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] Spawned new privsep daemon via rootwrap Jul 09 09:59:09 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] Accepted privsep connection to /tmp/tmp4i9b054q/privsep.sock {{(pid=87192) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 09 09:59:09 devstack cinder-volume[87192]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 09 09:59:09 devstack cinder-volume[87192]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 09 09:59:09 devstack cinder-volume[87192]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 09 09:59:09 devstack cinder-volume[87192]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88324 Jul 09 09:59:09 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[836aa867-8151-441b-bcfd-0bc09de900c4]: (2,) {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:59:09 devstack cinder-volume[87192]: WARNING oslo_privsep.priv_context [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] privsep daemon already running Jul 09 09:59:09 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2a12256-79f2-4389-afbc-efaae90b9e0a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:59:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:09 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fb112fc-6cf0-4827-9852-3323f7757682]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:59:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e1aab42e-1fc1-461b-9fe7-defc4e1cc682 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:09 devstack sudo[88334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e1aab42e-1fc1-461b-9fe7-defc4e1cc682 Jul 09 09:59:09 devstack sudo[88334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:10 devstack sudo[88333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e Jul 09 09:59:10 devstack sudo[88333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:11 devstack sudo[88334]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e1aab42e-1fc1-461b-9fe7-defc4e1cc682" returned: 0 in 2.026s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e1aab42e-1fc1-461b-9fe7-defc4e1cc682 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:11 devstack sudo[88333]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e" returned: 0 in 2.104s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.33e60aac-f61a-479b-8337-fd841b9adf95 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:11 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e1aab42e-1fc1-461b-9fe7-defc4e1cc682 Jul 09 09:59:11 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:11 devstack sudo[88353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.33e60aac-f61a-479b-8337-fd841b9adf95 1G Jul 09 09:59:11 devstack sudo[88353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:13 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e1aab42e-1fc1-461b-9fe7-defc4e1cc682" returned: 0 in 1.457s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] Lock "cinder-quobyte-e1aab42e-1fc1-461b-9fe7-defc4e1cc682" released by "delete_volume" :: held 4.481s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:59:13 devstack cinder-volume[87192]: WARNING cinder.quota [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:59:13 devstack cinder-volume[87192]: WARNING cinder.quota [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:59:13 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] Created reservations ['473042f2-54e4-43d2-8a83-64de92b50dfd', '9d9b71d6-55b1-4a23-a2de-2d9c875347fb', '3fee2425-df80-472f-8cd3-602ef9df399f', 'df9286e0-ef10-41e6-b87d-70a5ccd598f6'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:59:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:59:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:59:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:59:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:59:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:59:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:13 devstack sudo[88379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 09:59:13 devstack sudo[88379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:13 devstack sudo[88353]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.33e60aac-f61a-479b-8337-fd841b9adf95 1G" returned: 0 in 2.122s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea05f193-9a72-4065-89a3-4a92dae4142e -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.33e60aac-f61a-479b-8337-fd841b9adf95 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:14 devstack sudo[88383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea05f193-9a72-4065-89a3-4a92dae4142e -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.33e60aac-f61a-479b-8337-fd841b9adf95 Jul 09 09:59:14 devstack sudo[88383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:15 devstack sudo[88383]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ea05f193-9a72-4065-89a3-4a92dae4142e -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.33e60aac-f61a-479b-8337-fd841b9adf95" returned: 0 in 1.952s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:15 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.33e60aac-f61a-479b-8337-fd841b9adf95 is being set with open permissions: ugo+rw Jul 09 09:59:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.33e60aac-f61a-479b-8337-fd841b9adf95 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:15 devstack sudo[88525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.33e60aac-f61a-479b-8337-fd841b9adf95 Jul 09 09:59:15 devstack sudo[88525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:16 devstack sudo[88379]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 2.299s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:16 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:59:16 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] Deleted volume successfully. Jul 09 09:59:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1c35686f-bd7a-4a8c-bb23-9f221234e61d tempest-VolumesAdminNegativeTest-741900234 None] Lock "cinder-e1aab42e-1fc1-461b-9fe7-defc4e1cc682-delete_volume" released by "delete_volume" :: held 7.571s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:59:17 devstack sudo[88525]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.33e60aac-f61a-479b-8337-fd841b9adf95" returned: 0 in 1.145s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:17 devstack sudo[88537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.info Jul 09 09:59:17 devstack sudo[88537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:18 devstack sudo[88537]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.info" returned: 0 in 1.363s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:18 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.info is being set with open permissions: ugo+rw Jul 09 09:59:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:18 devstack sudo[88592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.info Jul 09 09:59:18 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:19 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.info" returned: 0 in 1.329s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 13.615s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:59:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-d07e8981-0465-4d1b-af6d-47b914bafd8a req-fa1e2561-9aed-456a-882c-9b868c26339d tempest-VolumesSnapshotsTestJSON-1309255089 None] Create snapshot completed successfully Jul 09 09:59:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] Acquiring lock "cinder-33e60aac-f61a-479b-8337-fd841b9adf95-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:59:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] Lock "cinder-33e60aac-f61a-479b-8337-fd841b9adf95-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:59:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] Acquiring lock "cinder-quobyte-ea05f193-9a72-4065-89a3-4a92dae4142e" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:59:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] Lock "cinder-quobyte-ea05f193-9a72-4065-89a3-4a92dae4142e" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:59:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] Acquiring lock "cinder-quobyte-33e60aac-f61a-479b-8337-fd841b9adf95" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:59:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] Lock "cinder-quobyte-33e60aac-f61a-479b-8337-fd841b9adf95" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:59:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] Deleting offline snapshot 33e60aac-f61a-479b-8337-fd841b9adf95 of volume ea05f193-9a72-4065-89a3-4a92dae4142e {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 09:59:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] snapshot_file for this snap is: volume-ea05f193-9a72-4065-89a3-4a92dae4142e.33e60aac-f61a-479b-8337-fd841b9adf95 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 09:59:21 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[70019af7-7dc8-426d-8eab-e2c5396343ac]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:59:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.33e60aac-f61a-479b-8337-fd841b9adf95 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:21 devstack sudo[88606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.33e60aac-f61a-479b-8337-fd841b9adf95 Jul 09 09:59:21 devstack sudo[88606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:23 devstack sudo[88606]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.33e60aac-f61a-479b-8337-fd841b9adf95" returned: 0 in 1.593s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ea05f193-9a72-4065-89a3-4a92dae4142e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 09:59:23 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[904cb379-7adf-4fa4-a593-d92b4688dd6b]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:59:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:23 devstack sudo[88634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e Jul 09 09:59:23 devstack sudo[88634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:24 devstack sudo[88634]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e" returned: 0 in 1.602s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.33e60aac-f61a-479b-8337-fd841b9adf95 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:24 devstack sudo[88648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.33e60aac-f61a-479b-8337-fd841b9adf95 Jul 09 09:59:24 devstack sudo[88648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:25 devstack sudo[88648]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.33e60aac-f61a-479b-8337-fd841b9adf95" returned: 0 in 1.125s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.33e60aac-f61a-479b-8337-fd841b9adf95 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:25 devstack sudo[88677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.33e60aac-f61a-479b-8337-fd841b9adf95 Jul 09 09:59:25 devstack sudo[88677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:26 devstack sudo[88677]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e.33e60aac-f61a-479b-8337-fd841b9adf95" returned: 0 in 1.183s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] Lock "cinder-quobyte-33e60aac-f61a-479b-8337-fd841b9adf95" released by "_delete_snapshot" :: held 5.753s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:59:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] Lock "cinder-quobyte-ea05f193-9a72-4065-89a3-4a92dae4142e" released by "delete_snapshot" :: held 5.818s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:59:27 devstack cinder-volume[87192]: WARNING cinder.quota [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 09 09:59:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e59fd7a3-6aa4-4a93-85bd-d52c5f4ce510 tempest-ServerRescueNegativeTestJSON-134814726 None] Acquiring lock "cinder-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:59:27 devstack cinder-volume[87192]: DEBUG cinder.quota [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] Created reservations ['bafd712d-956f-4e20-89aa-ecdc8a789e91', '51ff9df1-d15d-42ed-a411-2b437652a262', '9ec21a9d-b004-4e8b-8020-e5f667a176bc', 'd3933d05-ba5b-4a35-8943-3158e91ce2d2'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:59:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e59fd7a3-6aa4-4a93-85bd-d52c5f4ce510 tempest-ServerRescueNegativeTestJSON-134814726 None] Lock "cinder-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:59:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e59fd7a3-6aa4-4a93-85bd-d52c5f4ce510 tempest-ServerRescueNegativeTestJSON-134814726 None] Acquiring lock "cinder-quobyte-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:59:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e59fd7a3-6aa4-4a93-85bd-d52c5f4ce510 tempest-ServerRescueNegativeTestJSON-134814726 None] Lock "cinder-quobyte-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c" acquired by "delete_volume" :: waited 0.036s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:59:27 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] Delete snapshot completed successfully. Jul 09 09:59:27 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb1183d7-8c03-401f-9176-44c1cc1703a4]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:59:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e59fd7a3-6aa4-4a93-85bd-d52c5f4ce510 tempest-ServerRescueNegativeTestJSON-134814726 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-9a17569e-1e4c-44fd-a23d-5b08fc64ff7e req-9edf10a0-654b-497d-b7c0-679136378152 tempest-VolumesSnapshotsTestJSON-1309255089 None] Lock "cinder-33e60aac-f61a-479b-8337-fd841b9adf95-delete_snapshot" released by "delete_snapshot" :: held 6.112s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:59:27 devstack sudo[88685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c Jul 09 09:59:27 devstack sudo[88685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-7f24ed73-0b9a-48f2-b25f-190d90f3a668 req-7035b2be-5b1d-4548-9253-9aa7d8126dad tempest-VolumesSnapshotsTestJSON-1309255089 None] Acquiring lock "cinder-ea05f193-9a72-4065-89a3-4a92dae4142e-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:59:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-7f24ed73-0b9a-48f2-b25f-190d90f3a668 req-7035b2be-5b1d-4548-9253-9aa7d8126dad tempest-VolumesSnapshotsTestJSON-1309255089 None] Lock "cinder-ea05f193-9a72-4065-89a3-4a92dae4142e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:59:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-7f24ed73-0b9a-48f2-b25f-190d90f3a668 req-7035b2be-5b1d-4548-9253-9aa7d8126dad tempest-VolumesSnapshotsTestJSON-1309255089 None] Acquiring lock "cinder-quobyte-ea05f193-9a72-4065-89a3-4a92dae4142e" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:59:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-7f24ed73-0b9a-48f2-b25f-190d90f3a668 req-7035b2be-5b1d-4548-9253-9aa7d8126dad tempest-VolumesSnapshotsTestJSON-1309255089 None] Lock "cinder-quobyte-ea05f193-9a72-4065-89a3-4a92dae4142e" acquired by "delete_volume" :: waited 0.039s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:59:28 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b887d0bd-5e2c-4fe9-a4a3-518482778d81]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:59:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-7f24ed73-0b9a-48f2-b25f-190d90f3a668 req-7035b2be-5b1d-4548-9253-9aa7d8126dad tempest-VolumesSnapshotsTestJSON-1309255089 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:28 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e Jul 09 09:59:28 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:28 devstack sudo[88685]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e59fd7a3-6aa4-4a93-85bd-d52c5f4ce510 tempest-ServerRescueNegativeTestJSON-134814726 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c" returned: 0 in 1.428s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e59fd7a3-6aa4-4a93-85bd-d52c5f4ce510 tempest-ServerRescueNegativeTestJSON-134814726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:28 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c Jul 09 09:59:28 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 09:59:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:59:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:59:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:59:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:59:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:29 devstack sudo[88724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 09:59:29 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:30 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e59fd7a3-6aa4-4a93-85bd-d52c5f4ce510 tempest-ServerRescueNegativeTestJSON-134814726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c" returned: 0 in 1.293s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e59fd7a3-6aa4-4a93-85bd-d52c5f4ce510 tempest-ServerRescueNegativeTestJSON-134814726 None] Lock "cinder-quobyte-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c" released by "delete_volume" :: held 2.790s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:59:30 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-e59fd7a3-6aa4-4a93-85bd-d52c5f4ce510 tempest-ServerRescueNegativeTestJSON-134814726 None] Created reservations ['c81445f0-3ee4-4a4a-8ea3-bef0b899c960', '4738b729-55a0-4a47-becd-74ff4e63bd21', '82ecbdef-3d2a-4a09-a11e-f00730e04438', 'f5b773c6-eb3c-4111-883c-1191e33c8f32'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:59:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e59fd7a3-6aa4-4a93-85bd-d52c5f4ce510 tempest-ServerRescueNegativeTestJSON-134814726 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:59:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e59fd7a3-6aa4-4a93-85bd-d52c5f4ce510 tempest-ServerRescueNegativeTestJSON-134814726 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:59:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e59fd7a3-6aa4-4a93-85bd-d52c5f4ce510 tempest-ServerRescueNegativeTestJSON-134814726 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:59:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e59fd7a3-6aa4-4a93-85bd-d52c5f4ce510 tempest-ServerRescueNegativeTestJSON-134814726 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:59:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e59fd7a3-6aa4-4a93-85bd-d52c5f4ce510 tempest-ServerRescueNegativeTestJSON-134814726 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:59:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e59fd7a3-6aa4-4a93-85bd-d52c5f4ce510 tempest-ServerRescueNegativeTestJSON-134814726 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:30 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-7f24ed73-0b9a-48f2-b25f-190d90f3a668 req-7035b2be-5b1d-4548-9253-9aa7d8126dad tempest-VolumesSnapshotsTestJSON-1309255089 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e" returned: 0 in 2.028s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:30 devstack sudo[88730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 09:59:30 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-7f24ed73-0b9a-48f2-b25f-190d90f3a668 req-7035b2be-5b1d-4548-9253-9aa7d8126dad tempest-VolumesSnapshotsTestJSON-1309255089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:30 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e Jul 09 09:59:30 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:31 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.293s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Flow 'volume_create_manager' (2e624012-62d9-474c-90cc-c7d203908d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9bafa9-feba-4d70-b107-bf98ec9cecdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e9bafa9-feba-4d70-b107-bf98ec9cecdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1536232300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22894346-fa67-4ca2-8afa-792c4e3ae78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b04c40a9a64ec59f480799698d14f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:59:31Z,use_quota=True,user_id='c892ab0fe4314bff9fe634409be13972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441f83c6-079a-4727-8dae-eebfdc22ff72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (441f83c6-079a-4727-8dae-eebfdc22ff72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04319d7b-033a-41c0-920f-729dc94de2aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04319d7b-033a-41c0-920f-729dc94de2aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22894346-fa67-4ca2-8afa-792c4e3ae78b', 'volume_name': 'volume-22894346-fa67-4ca2-8afa-792c4e3ae78b', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cedd0c1f-5b97-4ec6-8c93-098cfeeb0849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cedd0c1f-5b97-4ec6-8c93-098cfeeb0849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db1b5e1a-c260-4198-8385-1204e644a470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:31 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Volume 22894346-fa67-4ca2-8afa-792c4e3ae78b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22894346-fa67-4ca2-8afa-792c4e3ae78b', 'volume_size': 1} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1536232300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22894346-fa67-4ca2-8afa-792c4e3ae78b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b04c40a9a64ec59f480799698d14f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:59:31Z,use_quota=True,user_id='c892ab0fe4314bff9fe634409be13972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Creating volume 22894346-fa67-4ca2-8afa-792c4e3ae78b {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:59:31 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 09:59:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-22894346-fa67-4ca2-8afa-792c4e3ae78b 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:31 devstack sudo[88739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-22894346-fa67-4ca2-8afa-792c4e3ae78b 1073741824 Jul 09 09:59:31 devstack sudo[88739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:31 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e59fd7a3-6aa4-4a93-85bd-d52c5f4ce510 tempest-ServerRescueNegativeTestJSON-134814726 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.390s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:32 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-e59fd7a3-6aa4-4a93-85bd-d52c5f4ce510 tempest-ServerRescueNegativeTestJSON-134814726 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:59:32 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e59fd7a3-6aa4-4a93-85bd-d52c5f4ce510 tempest-ServerRescueNegativeTestJSON-134814726 None] Deleted volume successfully. Jul 09 09:59:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e59fd7a3-6aa4-4a93-85bd-d52c5f4ce510 tempest-ServerRescueNegativeTestJSON-134814726 None] Lock "cinder-42c5a11c-4a45-4dc9-98e1-d2c9c010d59c-delete_volume" released by "delete_volume" :: held 4.776s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:59:32 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-7f24ed73-0b9a-48f2-b25f-190d90f3a668 req-7035b2be-5b1d-4548-9253-9aa7d8126dad tempest-VolumesSnapshotsTestJSON-1309255089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ea05f193-9a72-4065-89a3-4a92dae4142e" returned: 0 in 1.466s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-7f24ed73-0b9a-48f2-b25f-190d90f3a668 req-7035b2be-5b1d-4548-9253-9aa7d8126dad tempest-VolumesSnapshotsTestJSON-1309255089 None] Lock "cinder-quobyte-ea05f193-9a72-4065-89a3-4a92dae4142e" released by "delete_volume" :: held 3.630s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:59:32 devstack cinder-volume[87192]: DEBUG cinder.quota [req-7f24ed73-0b9a-48f2-b25f-190d90f3a668 req-7035b2be-5b1d-4548-9253-9aa7d8126dad tempest-VolumesSnapshotsTestJSON-1309255089 None] Created reservations ['f6f853fc-714c-4fd1-813a-42b0bb910c1f', '78e99db6-3b61-45db-9957-c0f4d7f062f5', '7e678ad5-9f77-49d8-9869-d8cd79dc8099', 'b8a85a04-83a6-4bfe-9b16-958658483bd1'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-7f24ed73-0b9a-48f2-b25f-190d90f3a668 req-7035b2be-5b1d-4548-9253-9aa7d8126dad tempest-VolumesSnapshotsTestJSON-1309255089 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-7f24ed73-0b9a-48f2-b25f-190d90f3a668 req-7035b2be-5b1d-4548-9253-9aa7d8126dad tempest-VolumesSnapshotsTestJSON-1309255089 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-7f24ed73-0b9a-48f2-b25f-190d90f3a668 req-7035b2be-5b1d-4548-9253-9aa7d8126dad tempest-VolumesSnapshotsTestJSON-1309255089 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:59:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-7f24ed73-0b9a-48f2-b25f-190d90f3a668 req-7035b2be-5b1d-4548-9253-9aa7d8126dad tempest-VolumesSnapshotsTestJSON-1309255089 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-7f24ed73-0b9a-48f2-b25f-190d90f3a668 req-7035b2be-5b1d-4548-9253-9aa7d8126dad tempest-VolumesSnapshotsTestJSON-1309255089 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:59:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-7f24ed73-0b9a-48f2-b25f-190d90f3a668 req-7035b2be-5b1d-4548-9253-9aa7d8126dad tempest-VolumesSnapshotsTestJSON-1309255089 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:32 devstack sudo[88743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 09:59:32 devstack sudo[88743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:33 devstack sudo[88739]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-22894346-fa67-4ca2-8afa-792c4e3ae78b 1073741824" returned: 0 in 1.342s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-22894346-fa67-4ca2-8afa-792c4e3ae78b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:33 devstack sudo[88768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-22894346-fa67-4ca2-8afa-792c4e3ae78b Jul 09 09:59:33 devstack sudo[88768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:33 devstack sudo[88743]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-7f24ed73-0b9a-48f2-b25f-190d90f3a668 req-7035b2be-5b1d-4548-9253-9aa7d8126dad tempest-VolumesSnapshotsTestJSON-1309255089 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.364s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:33 devstack cinder-volume[87192]: DEBUG cinder.manager [req-7f24ed73-0b9a-48f2-b25f-190d90f3a668 req-7035b2be-5b1d-4548-9253-9aa7d8126dad tempest-VolumesSnapshotsTestJSON-1309255089 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:59:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-7f24ed73-0b9a-48f2-b25f-190d90f3a668 req-7035b2be-5b1d-4548-9253-9aa7d8126dad tempest-VolumesSnapshotsTestJSON-1309255089 None] Deleted volume successfully. Jul 09 09:59:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-7f24ed73-0b9a-48f2-b25f-190d90f3a668 req-7035b2be-5b1d-4548-9253-9aa7d8126dad tempest-VolumesSnapshotsTestJSON-1309255089 None] Lock "cinder-ea05f193-9a72-4065-89a3-4a92dae4142e-delete_volume" released by "delete_volume" :: held 5.343s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:59:34 devstack sudo[88768]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-22894346-fa67-4ca2-8afa-792c4e3ae78b" returned: 0 in 1.295s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] <== create_volume: return (2786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:59:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.788s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:59:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db1b5e1a-c260-4198-8385-1204e644a470) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22894346-fa67-4ca2-8afa-792c4e3ae78b', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e62426-b146-45a8-aede-faae68ded05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:34 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Volume volume-22894346-fa67-4ca2-8afa-792c4e3ae78b (22894346-fa67-4ca2-8afa-792c4e3ae78b): created successfully Jul 09 09:59:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20e62426-b146-45a8-aede-faae68ded05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Flow 'volume_create_manager' (2e624012-62d9-474c-90cc-c7d203908d2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:59:34 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3bb7ba57-ada4-45d6-901c-41e0ed45fe04 tempest-ServersNegativeTestJSON-588307373 None] Created volume successfully. Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Flow 'volume_create_manager' (ce0b8ced-3ff2-4b15-95b7-f69e5a50b45e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c663d3-fece-426f-bebb-9b924f9d6a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75c663d3-fece-426f-bebb-9b924f9d6a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1234410188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51913705-d001-442c-8ad0-6c862178fb8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b04c40a9a64ec59f480799698d14f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:59:38Z,use_quota=True,user_id='c892ab0fe4314bff9fe634409be13972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21fb1ba5-76c7-4540-9b9f-b5c38fa981f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (21fb1ba5-76c7-4540-9b9f-b5c38fa981f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f98be0-dadb-4edb-aae6-271b8fc26c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (54f98be0-dadb-4edb-aae6-271b8fc26c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51913705-d001-442c-8ad0-6c862178fb8b', 'volume_name': 'volume-51913705-d001-442c-8ad0-6c862178fb8b', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc69edd6-8c27-4dfb-a27f-7fe61122cddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc69edd6-8c27-4dfb-a27f-7fe61122cddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83021227-ae4b-4a52-956a-952f084c1c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:38 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Volume 51913705-d001-442c-8ad0-6c862178fb8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51913705-d001-442c-8ad0-6c862178fb8b', 'volume_size': 1} Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:59:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1234410188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51913705-d001-442c-8ad0-6c862178fb8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3b04c40a9a64ec59f480799698d14f9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:59:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:59:38Z,use_quota=True,user_id='c892ab0fe4314bff9fe634409be13972',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Creating volume 51913705-d001-442c-8ad0-6c862178fb8b {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:59:38 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 09:59:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-51913705-d001-442c-8ad0-6c862178fb8b 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:38 devstack sudo[88788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-51913705-d001-442c-8ad0-6c862178fb8b 1073741824 Jul 09 09:59:38 devstack sudo[88788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:39 devstack sudo[88788]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-51913705-d001-442c-8ad0-6c862178fb8b 1073741824" returned: 0 in 1.169s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-51913705-d001-442c-8ad0-6c862178fb8b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:39 devstack sudo[88796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-51913705-d001-442c-8ad0-6c862178fb8b Jul 09 09:59:39 devstack sudo[88796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Flow 'volume_create_manager' (72430a39-9724-4dac-965f-50a15a50829d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a92f3bc-2783-4cde-8fe5-e55efcc1247f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a92f3bc-2783-4cde-8fe5-e55efcc1247f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1529295720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d06a66b-0ea0-4e32-8086-a067b8527aa1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55ec7cfaf4a742dc89d6a19ac11c336a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:59:40Z,use_quota=True,user_id='4db47d9d9e164e668750d99933b1e4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bcb6404-2c6f-461c-8812-03951e87e33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bcb6404-2c6f-461c-8812-03951e87e33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f231217-83d1-4942-89a5-3636722e7e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f231217-83d1-4942-89a5-3636722e7e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d06a66b-0ea0-4e32-8086-a067b8527aa1', 'volume_name': 'volume-2d06a66b-0ea0-4e32-8086-a067b8527aa1', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d805b1a-ae7b-49cf-a02b-5aab53b47818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d805b1a-ae7b-49cf-a02b-5aab53b47818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3168f2d-bbba-4fea-8775-9a48654fb670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:40 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Volume 2d06a66b-0ea0-4e32-8086-a067b8527aa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d06a66b-0ea0-4e32-8086-a067b8527aa1', 'volume_size': 1} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:59:40 devstack sudo[88796]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-51913705-d001-442c-8ad0-6c862178fb8b" returned: 0 in 0.836s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] <== create_volume: return (2067ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.071s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.129s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:59:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1529295720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d06a66b-0ea0-4e32-8086-a067b8527aa1,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='55ec7cfaf4a742dc89d6a19ac11c336a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:59:40Z,use_quota=True,user_id='4db47d9d9e164e668750d99933b1e4c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Creating volume 2d06a66b-0ea0-4e32-8086-a067b8527aa1 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:59:40 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2d06a66b-0ea0-4e32-8086-a067b8527aa1 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:40 devstack sudo[88807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2d06a66b-0ea0-4e32-8086-a067b8527aa1 1073741824 Jul 09 09:59:40 devstack sudo[88807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83021227-ae4b-4a52-956a-952f084c1c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51913705-d001-442c-8ad0-6c862178fb8b', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b27309-16ea-4f2c-9afa-65675218d796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:40 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Volume volume-51913705-d001-442c-8ad0-6c862178fb8b (51913705-d001-442c-8ad0-6c862178fb8b): created successfully Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80b27309-16ea-4f2c-9afa-65675218d796) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Flow 'volume_create_manager' (ce0b8ced-3ff2-4b15-95b7-f69e5a50b45e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:59:40 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-259000ca-c9a6-47ad-b66d-5d0da4886282 tempest-ServersNegativeTestJSON-588307373 None] Created volume successfully. Jul 09 09:59:41 devstack sudo[88807]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2d06a66b-0ea0-4e32-8086-a067b8527aa1 1073741824" returned: 0 in 0.919s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2d06a66b-0ea0-4e32-8086-a067b8527aa1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:41 devstack sudo[88818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2d06a66b-0ea0-4e32-8086-a067b8527aa1 Jul 09 09:59:41 devstack sudo[88818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c797443e-6a1f-49f7-afad-829010dfc01d tempest-ServersNegativeTestJSON-588307373 None] Acquiring lock "cinder-51913705-d001-442c-8ad0-6c862178fb8b-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:59:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c797443e-6a1f-49f7-afad-829010dfc01d tempest-ServersNegativeTestJSON-588307373 None] Lock "cinder-51913705-d001-442c-8ad0-6c862178fb8b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:59:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c797443e-6a1f-49f7-afad-829010dfc01d tempest-ServersNegativeTestJSON-588307373 None] Acquiring lock "cinder-quobyte-51913705-d001-442c-8ad0-6c862178fb8b" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:59:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c797443e-6a1f-49f7-afad-829010dfc01d tempest-ServersNegativeTestJSON-588307373 None] Lock "cinder-quobyte-51913705-d001-442c-8ad0-6c862178fb8b" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:59:42 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f092e16c-0537-4743-901d-77d6c40d4963]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:59:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c797443e-6a1f-49f7-afad-829010dfc01d tempest-ServersNegativeTestJSON-588307373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-51913705-d001-442c-8ad0-6c862178fb8b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:42 devstack sudo[88818]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2d06a66b-0ea0-4e32-8086-a067b8527aa1" returned: 0 in 0.934s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] <== create_volume: return (1900ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:59:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.903s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:59:42 devstack sudo[88833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-51913705-d001-442c-8ad0-6c862178fb8b Jul 09 09:59:42 devstack sudo[88833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3168f2d-bbba-4fea-8775-9a48654fb670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d06a66b-0ea0-4e32-8086-a067b8527aa1', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afaf3df9-9f61-406e-9f05-218c7f2b20e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:42 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Volume volume-2d06a66b-0ea0-4e32-8086-a067b8527aa1 (2d06a66b-0ea0-4e32-8086-a067b8527aa1): created successfully Jul 09 09:59:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afaf3df9-9f61-406e-9f05-218c7f2b20e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Flow 'volume_create_manager' (72430a39-9724-4dac-965f-50a15a50829d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:59:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-9c55a373-455f-4019-92d3-57ed33b5f539 req-ed938e42-1b7c-4dfa-a018-a1b06a3a231e tempest-VolumesGetTestJSON-770497335 None] Created volume successfully. Jul 09 09:59:42 devstack sudo[88833]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c797443e-6a1f-49f7-afad-829010dfc01d tempest-ServersNegativeTestJSON-588307373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-51913705-d001-442c-8ad0-6c862178fb8b" returned: 0 in 0.951s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c797443e-6a1f-49f7-afad-829010dfc01d tempest-ServersNegativeTestJSON-588307373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-51913705-d001-442c-8ad0-6c862178fb8b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:43 devstack sudo[88842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-51913705-d001-442c-8ad0-6c862178fb8b Jul 09 09:59:43 devstack sudo[88842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-f72473e1-c5e0-42ac-a135-78c95ff90646 req-558a67d7-3897-4fec-a197-e2435d774716 tempest-VolumesGetTestJSON-770497335 None] Acquiring lock "cinder-2d06a66b-0ea0-4e32-8086-a067b8527aa1-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:59:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-f72473e1-c5e0-42ac-a135-78c95ff90646 req-558a67d7-3897-4fec-a197-e2435d774716 tempest-VolumesGetTestJSON-770497335 None] Lock "cinder-2d06a66b-0ea0-4e32-8086-a067b8527aa1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:59:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-f72473e1-c5e0-42ac-a135-78c95ff90646 req-558a67d7-3897-4fec-a197-e2435d774716 tempest-VolumesGetTestJSON-770497335 None] Acquiring lock "cinder-quobyte-2d06a66b-0ea0-4e32-8086-a067b8527aa1" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:59:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-f72473e1-c5e0-42ac-a135-78c95ff90646 req-558a67d7-3897-4fec-a197-e2435d774716 tempest-VolumesGetTestJSON-770497335 None] Lock "cinder-quobyte-2d06a66b-0ea0-4e32-8086-a067b8527aa1" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:59:43 devstack sudo[88842]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c797443e-6a1f-49f7-afad-829010dfc01d tempest-ServersNegativeTestJSON-588307373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-51913705-d001-442c-8ad0-6c862178fb8b" returned: 0 in 0.757s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:43 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[077f57e7-9f5e-401a-bdd1-2a23ba8999e4]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:59:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-f72473e1-c5e0-42ac-a135-78c95ff90646 req-558a67d7-3897-4fec-a197-e2435d774716 tempest-VolumesGetTestJSON-770497335 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2d06a66b-0ea0-4e32-8086-a067b8527aa1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c797443e-6a1f-49f7-afad-829010dfc01d tempest-ServersNegativeTestJSON-588307373 None] Lock "cinder-quobyte-51913705-d001-442c-8ad0-6c862178fb8b" released by "delete_volume" :: held 1.778s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:59:43 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c797443e-6a1f-49f7-afad-829010dfc01d tempest-ServersNegativeTestJSON-588307373 None] Created reservations ['49a50527-0821-4eed-85e4-3b84e04f1581', '06870b08-77ec-4c68-aa40-d8047fcf33be', 'ebf10532-46fc-40f7-a867-c549c5256ea2', '10e00f2d-0f76-4ba6-9785-fce0c28a9e8a'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:59:43 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2d06a66b-0ea0-4e32-8086-a067b8527aa1 Jul 09 09:59:43 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c797443e-6a1f-49f7-afad-829010dfc01d tempest-ServersNegativeTestJSON-588307373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:59:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c797443e-6a1f-49f7-afad-829010dfc01d tempest-ServersNegativeTestJSON-588307373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:59:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c797443e-6a1f-49f7-afad-829010dfc01d tempest-ServersNegativeTestJSON-588307373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:59:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c797443e-6a1f-49f7-afad-829010dfc01d tempest-ServersNegativeTestJSON-588307373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:59:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c797443e-6a1f-49f7-afad-829010dfc01d tempest-ServersNegativeTestJSON-588307373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:59:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c797443e-6a1f-49f7-afad-829010dfc01d tempest-ServersNegativeTestJSON-588307373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:43 devstack sudo[88848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 09:59:43 devstack sudo[88848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-39788d37-30af-4772-9591-cc1cf8405f1a tempest-ServersNegativeTestJSON-588307373 None] Acquiring lock "cinder-22894346-fa67-4ca2-8afa-792c4e3ae78b-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:59:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-39788d37-30af-4772-9591-cc1cf8405f1a tempest-ServersNegativeTestJSON-588307373 None] Lock "cinder-22894346-fa67-4ca2-8afa-792c4e3ae78b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:59:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-39788d37-30af-4772-9591-cc1cf8405f1a tempest-ServersNegativeTestJSON-588307373 None] Acquiring lock "cinder-quobyte-22894346-fa67-4ca2-8afa-792c4e3ae78b" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 09:59:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-39788d37-30af-4772-9591-cc1cf8405f1a tempest-ServersNegativeTestJSON-588307373 None] Lock "cinder-quobyte-22894346-fa67-4ca2-8afa-792c4e3ae78b" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 09:59:44 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a19f0d05-44d4-48e4-8f7f-1bf3276de37c]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:59:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-39788d37-30af-4772-9591-cc1cf8405f1a tempest-ServersNegativeTestJSON-588307373 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-22894346-fa67-4ca2-8afa-792c4e3ae78b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:44 devstack sudo[88848]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c797443e-6a1f-49f7-afad-829010dfc01d tempest-ServersNegativeTestJSON-588307373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.873s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:44 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-c797443e-6a1f-49f7-afad-829010dfc01d tempest-ServersNegativeTestJSON-588307373 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:59:44 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c797443e-6a1f-49f7-afad-829010dfc01d tempest-ServersNegativeTestJSON-588307373 None] Deleted volume successfully. Jul 09 09:59:44 devstack sudo[88851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-22894346-fa67-4ca2-8afa-792c4e3ae78b Jul 09 09:59:44 devstack sudo[88851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c797443e-6a1f-49f7-afad-829010dfc01d tempest-ServersNegativeTestJSON-588307373 None] Lock "cinder-51913705-d001-442c-8ad0-6c862178fb8b-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:59:44 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-f72473e1-c5e0-42ac-a135-78c95ff90646 req-558a67d7-3897-4fec-a197-e2435d774716 tempest-VolumesGetTestJSON-770497335 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2d06a66b-0ea0-4e32-8086-a067b8527aa1" returned: 0 in 1.145s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-f72473e1-c5e0-42ac-a135-78c95ff90646 req-558a67d7-3897-4fec-a197-e2435d774716 tempest-VolumesGetTestJSON-770497335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2d06a66b-0ea0-4e32-8086-a067b8527aa1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:44 devstack sudo[88858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2d06a66b-0ea0-4e32-8086-a067b8527aa1 Jul 09 09:59:44 devstack sudo[88858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:45 devstack sudo[88851]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-39788d37-30af-4772-9591-cc1cf8405f1a tempest-ServersNegativeTestJSON-588307373 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-22894346-fa67-4ca2-8afa-792c4e3ae78b" returned: 0 in 0.898s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-39788d37-30af-4772-9591-cc1cf8405f1a tempest-ServersNegativeTestJSON-588307373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-22894346-fa67-4ca2-8afa-792c4e3ae78b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:45 devstack sudo[88864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-22894346-fa67-4ca2-8afa-792c4e3ae78b Jul 09 09:59:45 devstack sudo[88864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:45 devstack sudo[88858]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-f72473e1-c5e0-42ac-a135-78c95ff90646 req-558a67d7-3897-4fec-a197-e2435d774716 tempest-VolumesGetTestJSON-770497335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2d06a66b-0ea0-4e32-8086-a067b8527aa1" returned: 0 in 0.753s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-f72473e1-c5e0-42ac-a135-78c95ff90646 req-558a67d7-3897-4fec-a197-e2435d774716 tempest-VolumesGetTestJSON-770497335 None] Lock "cinder-quobyte-2d06a66b-0ea0-4e32-8086-a067b8527aa1" released by "delete_volume" :: held 1.950s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:59:45 devstack cinder-volume[87192]: DEBUG cinder.quota [req-f72473e1-c5e0-42ac-a135-78c95ff90646 req-558a67d7-3897-4fec-a197-e2435d774716 tempest-VolumesGetTestJSON-770497335 None] Created reservations ['a8800a23-42b9-4c33-8249-6ad6a51cee43', 'f1d1d15e-da61-4a52-a9e6-cab1c3a48bd6', 'bf494951-b78f-4c84-81cf-e6ffc0d4db6a', '972e2c3c-4789-4d6d-98d8-59ddd6f72bb1'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:59:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-f72473e1-c5e0-42ac-a135-78c95ff90646 req-558a67d7-3897-4fec-a197-e2435d774716 tempest-VolumesGetTestJSON-770497335 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:59:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-f72473e1-c5e0-42ac-a135-78c95ff90646 req-558a67d7-3897-4fec-a197-e2435d774716 tempest-VolumesGetTestJSON-770497335 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:59:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-f72473e1-c5e0-42ac-a135-78c95ff90646 req-558a67d7-3897-4fec-a197-e2435d774716 tempest-VolumesGetTestJSON-770497335 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:59:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-f72473e1-c5e0-42ac-a135-78c95ff90646 req-558a67d7-3897-4fec-a197-e2435d774716 tempest-VolumesGetTestJSON-770497335 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:59:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-f72473e1-c5e0-42ac-a135-78c95ff90646 req-558a67d7-3897-4fec-a197-e2435d774716 tempest-VolumesGetTestJSON-770497335 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:59:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-f72473e1-c5e0-42ac-a135-78c95ff90646 req-558a67d7-3897-4fec-a197-e2435d774716 tempest-VolumesGetTestJSON-770497335 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:45 devstack sudo[88866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 09:59:45 devstack sudo[88866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:46 devstack sudo[88864]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-39788d37-30af-4772-9591-cc1cf8405f1a tempest-ServersNegativeTestJSON-588307373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-22894346-fa67-4ca2-8afa-792c4e3ae78b" returned: 0 in 0.845s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-39788d37-30af-4772-9591-cc1cf8405f1a tempest-ServersNegativeTestJSON-588307373 None] Lock "cinder-quobyte-22894346-fa67-4ca2-8afa-792c4e3ae78b" released by "delete_volume" :: held 1.820s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:59:46 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-39788d37-30af-4772-9591-cc1cf8405f1a tempest-ServersNegativeTestJSON-588307373 None] Created reservations ['1110032f-4fb3-4597-853b-6904a5256080', '64f8e4ec-e34f-4192-87ed-a6fdd9911647', 'bdea3870-1622-4ade-8a06-a43d5039d944', '93aee05b-b928-4052-af1f-463ba32bcb7c'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 09:59:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-39788d37-30af-4772-9591-cc1cf8405f1a tempest-ServersNegativeTestJSON-588307373 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:59:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-39788d37-30af-4772-9591-cc1cf8405f1a tempest-ServersNegativeTestJSON-588307373 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:59:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-39788d37-30af-4772-9591-cc1cf8405f1a tempest-ServersNegativeTestJSON-588307373 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:59:46 devstack sudo[88866]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-39788d37-30af-4772-9591-cc1cf8405f1a tempest-ServersNegativeTestJSON-588307373 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:59:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-39788d37-30af-4772-9591-cc1cf8405f1a tempest-ServersNegativeTestJSON-588307373 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:59:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-39788d37-30af-4772-9591-cc1cf8405f1a tempest-ServersNegativeTestJSON-588307373 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-f72473e1-c5e0-42ac-a135-78c95ff90646 req-558a67d7-3897-4fec-a197-e2435d774716 tempest-VolumesGetTestJSON-770497335 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.787s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:46 devstack cinder-volume[87192]: DEBUG cinder.manager [req-f72473e1-c5e0-42ac-a135-78c95ff90646 req-558a67d7-3897-4fec-a197-e2435d774716 tempest-VolumesGetTestJSON-770497335 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:59:46 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-f72473e1-c5e0-42ac-a135-78c95ff90646 req-558a67d7-3897-4fec-a197-e2435d774716 tempest-VolumesGetTestJSON-770497335 None] Deleted volume successfully. Jul 09 09:59:46 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 09:59:46 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-f72473e1-c5e0-42ac-a135-78c95ff90646 req-558a67d7-3897-4fec-a197-e2435d774716 tempest-VolumesGetTestJSON-770497335 None] Lock "cinder-2d06a66b-0ea0-4e32-8086-a067b8527aa1-delete_volume" released by "delete_volume" :: held 3.042s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:59:47 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-39788d37-30af-4772-9591-cc1cf8405f1a tempest-ServersNegativeTestJSON-588307373 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.952s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:47 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-39788d37-30af-4772-9591-cc1cf8405f1a tempest-ServersNegativeTestJSON-588307373 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 09:59:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-39788d37-30af-4772-9591-cc1cf8405f1a tempest-ServersNegativeTestJSON-588307373 None] Deleted volume successfully. Jul 09 09:59:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-39788d37-30af-4772-9591-cc1cf8405f1a tempest-ServersNegativeTestJSON-588307373 None] Lock "cinder-22894346-fa67-4ca2-8afa-792c4e3ae78b-delete_volume" released by "delete_volume" :: held 3.138s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:INSERT=19,cinder:UPDATE=70,cinder:SELECT=46,cinder:DELETE=6 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=58,cinder:UPDATE=78,cinder:DELETE=7,cinder:INSERT=16 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Flow 'volume_create_manager' (2f3d0b4a-8d2a-46a7-affd-f8e9ff93b7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a36c73c-a37a-4c32-b8b1-77a4e220cab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a36c73c-a37a-4c32-b8b1-77a4e220cab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-472274590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d9efb2-8294-4b27-9cad-e060336cc379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b69846ef9f482f8136fa81adbe84d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:59:52Z,use_quota=True,user_id='6833bbec75694a4f9fd6eade7a69a22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db03d42-504f-445b-a0cb-a0ddd8c16961) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db03d42-504f-445b-a0cb-a0ddd8c16961) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd65d70-a5ec-4ef8-bfd5-2d334e738cc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddd65d70-a5ec-4ef8-bfd5-2d334e738cc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15d9efb2-8294-4b27-9cad-e060336cc379', 'volume_name': 'volume-15d9efb2-8294-4b27-9cad-e060336cc379', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0297152-fa04-4022-91ec-66e78c50a154) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0297152-fa04-4022-91ec-66e78c50a154) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c5914c-85a5-4a48-a960-f5e7939ce8b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:52 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Volume 15d9efb2-8294-4b27-9cad-e060336cc379: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15d9efb2-8294-4b27-9cad-e060336cc379', 'volume_size': 1} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T07:59:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-472274590',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15d9efb2-8294-4b27-9cad-e060336cc379,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='63b69846ef9f482f8136fa81adbe84d7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T07:59:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T07:59:52Z,use_quota=True,user_id='6833bbec75694a4f9fd6eade7a69a22a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Creating volume 15d9efb2-8294-4b27-9cad-e060336cc379 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 09:59:52 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 09:59:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:52 devstack sudo[88905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379 1073741824 Jul 09 09:59:52 devstack sudo[88905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:53 devstack sudo[88905]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379 1073741824" returned: 0 in 0.933s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:53 devstack sudo[88911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379 Jul 09 09:59:53 devstack sudo[88911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:54 devstack sudo[88911]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379" returned: 0 in 0.845s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] <== create_volume: return (1827ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 09:59:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.830s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 09:59:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c5914c-85a5-4a48-a960-f5e7939ce8b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15d9efb2-8294-4b27-9cad-e060336cc379', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63977f5-927c-41f3-9364-3f45112dc5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 09:59:54 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Volume volume-15d9efb2-8294-4b27-9cad-e060336cc379 (15d9efb2-8294-4b27-9cad-e060336cc379): created successfully Jul 09 09:59:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f63977f5-927c-41f3-9364-3f45112dc5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 09:59:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Flow 'volume_create_manager' (2f3d0b4a-8d2a-46a7-affd-f8e9ff93b7db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 09:59:54 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-298afeab-6132-43b5-859c-4f41eb256bf8 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Created volume successfully. Jul 09 09:59:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d111ba70-0a52-4ca7-9dfa-b26aede6b44a tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 09:59:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d111ba70-0a52-4ca7-9dfa-b26aede6b44a tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 09:59:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d111ba70-0a52-4ca7-9dfa-b26aede6b44a tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Creating offline snapshot 9af6d92c-0f9d-4d5a-875c-2b904ebff767 of volume 15d9efb2-8294-4b27-9cad-e060336cc379 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 09:59:56 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c58d4d-a809-4152-946d-3c6c5e51e193]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 09:59:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d111ba70-0a52-4ca7-9dfa-b26aede6b44a tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:56 devstack sudo[88915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379 Jul 09 09:59:56 devstack sudo[88915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:56 devstack sudo[88915]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d111ba70-0a52-4ca7-9dfa-b26aede6b44a tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379" returned: 0 in 0.824s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d111ba70-0a52-4ca7-9dfa-b26aede6b44a tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.9af6d92c-0f9d-4d5a-875c-2b904ebff767 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:56 devstack sudo[88921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.9af6d92c-0f9d-4d5a-875c-2b904ebff767 1G Jul 09 09:59:56 devstack sudo[88921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:57 devstack sudo[88921]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d111ba70-0a52-4ca7-9dfa-b26aede6b44a tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.9af6d92c-0f9d-4d5a-875c-2b904ebff767 1G" returned: 0 in 0.879s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d111ba70-0a52-4ca7-9dfa-b26aede6b44a tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15d9efb2-8294-4b27-9cad-e060336cc379 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.9af6d92c-0f9d-4d5a-875c-2b904ebff767 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:57 devstack sudo[88928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15d9efb2-8294-4b27-9cad-e060336cc379 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.9af6d92c-0f9d-4d5a-875c-2b904ebff767 Jul 09 09:59:57 devstack sudo[88928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:58 devstack sudo[88928]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d111ba70-0a52-4ca7-9dfa-b26aede6b44a tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-15d9efb2-8294-4b27-9cad-e060336cc379 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.9af6d92c-0f9d-4d5a-875c-2b904ebff767" returned: 0 in 0.770s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:58 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-d111ba70-0a52-4ca7-9dfa-b26aede6b44a tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.9af6d92c-0f9d-4d5a-875c-2b904ebff767 is being set with open permissions: ugo+rw Jul 09 09:59:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d111ba70-0a52-4ca7-9dfa-b26aede6b44a tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.9af6d92c-0f9d-4d5a-875c-2b904ebff767 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:58 devstack sudo[88933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.9af6d92c-0f9d-4d5a-875c-2b904ebff767 Jul 09 09:59:58 devstack sudo[88933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 09:59:59 devstack sudo[88933]: pam_unix(sudo:session): session closed for user root Jul 09 09:59:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d111ba70-0a52-4ca7-9dfa-b26aede6b44a tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.9af6d92c-0f9d-4d5a-875c-2b904ebff767" returned: 0 in 0.682s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 09:59:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d111ba70-0a52-4ca7-9dfa-b26aede6b44a tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 09:59:59 devstack sudo[88937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.info Jul 09 09:59:59 devstack sudo[88937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:00:00 devstack sudo[88937]: pam_unix(sudo:session): session closed for user root Jul 09 10:00:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d111ba70-0a52-4ca7-9dfa-b26aede6b44a tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.info" returned: 0 in 0.789s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:00:00 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-d111ba70-0a52-4ca7-9dfa-b26aede6b44a tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.info is being set with open permissions: ugo+rw Jul 09 10:00:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d111ba70-0a52-4ca7-9dfa-b26aede6b44a tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:00:00 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.info Jul 09 10:00:00 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:00:00 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Jul 09 10:00:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d111ba70-0a52-4ca7-9dfa-b26aede6b44a tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.info" returned: 0 in 0.840s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:00:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d111ba70-0a52-4ca7-9dfa-b26aede6b44a tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.935s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:00:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d111ba70-0a52-4ca7-9dfa-b26aede6b44a tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Create snapshot completed successfully Jul 09 10:00:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Acquiring lock "cinder-9af6d92c-0f9d-4d5a-875c-2b904ebff767-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:00:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Lock "cinder-9af6d92c-0f9d-4d5a-875c-2b904ebff767-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:00:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Acquiring lock "cinder-quobyte-15d9efb2-8294-4b27-9cad-e060336cc379" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:00:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Lock "cinder-quobyte-15d9efb2-8294-4b27-9cad-e060336cc379" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:00:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Acquiring lock "cinder-quobyte-9af6d92c-0f9d-4d5a-875c-2b904ebff767" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:00:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Lock "cinder-quobyte-9af6d92c-0f9d-4d5a-875c-2b904ebff767" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:00:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Deleting offline snapshot 9af6d92c-0f9d-4d5a-875c-2b904ebff767 of volume 15d9efb2-8294-4b27-9cad-e060336cc379 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:00:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] snapshot_file for this snap is: volume-15d9efb2-8294-4b27-9cad-e060336cc379.9af6d92c-0f9d-4d5a-875c-2b904ebff767 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:00:01 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f02fc3be-fb4a-4c08-b816-00f50190ca4d]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:00:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.9af6d92c-0f9d-4d5a-875c-2b904ebff767 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:00:02 devstack sudo[88944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.9af6d92c-0f9d-4d5a-875c-2b904ebff767 Jul 09 10:00:02 devstack sudo[88944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:00:02 devstack sudo[88944]: pam_unix(sudo:session): session closed for user root Jul 09 10:00:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.9af6d92c-0f9d-4d5a-875c-2b904ebff767" returned: 0 in 0.865s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:00:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-15d9efb2-8294-4b27-9cad-e060336cc379(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:00:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[cea72785-78e3-453c-8ef0-10edc715d276]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:00:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:00:02 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379 Jul 09 10:00:02 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:00:03 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Jul 09 10:00:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379" returned: 0 in 0.870s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:00:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.9af6d92c-0f9d-4d5a-875c-2b904ebff767 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:00:03 devstack sudo[88959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.9af6d92c-0f9d-4d5a-875c-2b904ebff767 Jul 09 10:00:03 devstack sudo[88959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:00:04 devstack sudo[88959]: pam_unix(sudo:session): session closed for user root Jul 09 10:00:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.9af6d92c-0f9d-4d5a-875c-2b904ebff767" returned: 0 in 0.962s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:00:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.9af6d92c-0f9d-4d5a-875c-2b904ebff767 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:00:04 devstack sudo[88968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.9af6d92c-0f9d-4d5a-875c-2b904ebff767 Jul 09 10:00:04 devstack sudo[88968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:00:05 devstack sudo[88968]: pam_unix(sudo:session): session closed for user root Jul 09 10:00:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379.9af6d92c-0f9d-4d5a-875c-2b904ebff767" returned: 0 in 0.909s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:00:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Lock "cinder-quobyte-9af6d92c-0f9d-4d5a-875c-2b904ebff767" released by "_delete_snapshot" :: held 3.742s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:00:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Lock "cinder-quobyte-15d9efb2-8294-4b27-9cad-e060336cc379" released by "delete_snapshot" :: held 3.772s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:00:05 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Created reservations ['7d381fc7-2dff-483e-bfc4-39b565aed608', 'e5a04ce6-3e1e-41f0-afb4-e108a49f3b9e', 'df53b341-c8b8-4930-8484-fef7133c6b36', '2b9e6362-4ad1-4de6-9154-41d9e4dc3677'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:00:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Delete snapshot completed successfully. Jul 09 10:00:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a6ec971d-544c-4231-b216-f9a44411645b tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Lock "cinder-9af6d92c-0f9d-4d5a-875c-2b904ebff767-delete_snapshot" released by "delete_snapshot" :: held 3.932s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:00:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ffacaedd-b6d8-4688-a94c-f4826b3a09f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Acquiring lock "cinder-15d9efb2-8294-4b27-9cad-e060336cc379-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:00:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ffacaedd-b6d8-4688-a94c-f4826b3a09f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Lock "cinder-15d9efb2-8294-4b27-9cad-e060336cc379-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:00:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ffacaedd-b6d8-4688-a94c-f4826b3a09f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Acquiring lock "cinder-quobyte-15d9efb2-8294-4b27-9cad-e060336cc379" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:00:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ffacaedd-b6d8-4688-a94c-f4826b3a09f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Lock "cinder-quobyte-15d9efb2-8294-4b27-9cad-e060336cc379" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:00:06 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[db56497a-a3a4-4da6-a307-fd7bc7d84316]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:00:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ffacaedd-b6d8-4688-a94c-f4826b3a09f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:00:06 devstack sudo[88971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379 Jul 09 10:00:06 devstack sudo[88971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:00:07 devstack sudo[88971]: pam_unix(sudo:session): session closed for user root Jul 09 10:00:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ffacaedd-b6d8-4688-a94c-f4826b3a09f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379" returned: 0 in 0.861s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:00:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ffacaedd-b6d8-4688-a94c-f4826b3a09f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:00:07 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379 Jul 09 10:00:07 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:00:08 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Jul 09 10:00:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ffacaedd-b6d8-4688-a94c-f4826b3a09f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-15d9efb2-8294-4b27-9cad-e060336cc379" returned: 0 in 0.744s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:00:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ffacaedd-b6d8-4688-a94c-f4826b3a09f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Lock "cinder-quobyte-15d9efb2-8294-4b27-9cad-e060336cc379" released by "delete_volume" :: held 1.678s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:00:08 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ffacaedd-b6d8-4688-a94c-f4826b3a09f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Created reservations ['847bed8d-ebe5-4128-abf8-0fd0411e74a3', 'e1178a37-fe42-4f13-8c58-ba13fb0137df', '37494c6a-6dab-4d1a-9c75-f5cac5411bd9', '7ca0fea5-9c57-429b-ab01-85c8d4ebe65a'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:00:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ffacaedd-b6d8-4688-a94c-f4826b3a09f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:00:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ffacaedd-b6d8-4688-a94c-f4826b3a09f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:00:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ffacaedd-b6d8-4688-a94c-f4826b3a09f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:00:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ffacaedd-b6d8-4688-a94c-f4826b3a09f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:00:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ffacaedd-b6d8-4688-a94c-f4826b3a09f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:00:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ffacaedd-b6d8-4688-a94c-f4826b3a09f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:00:08 devstack sudo[88980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:00:08 devstack sudo[88980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:00:09 devstack sudo[88980]: pam_unix(sudo:session): session closed for user root Jul 09 10:00:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ffacaedd-b6d8-4688-a94c-f4826b3a09f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.808s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:00:09 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-ffacaedd-b6d8-4688-a94c-f4826b3a09f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:00:09 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ffacaedd-b6d8-4688-a94c-f4826b3a09f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Deleted volume successfully. Jul 09 10:00:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ffacaedd-b6d8-4688-a94c-f4826b3a09f4 tempest-VolumeSnapshotQuotasNegativeTestJSON-775483751 None] Lock "cinder-15d9efb2-8294-4b27-9cad-e060336cc379-delete_volume" released by "delete_volume" :: held 2.887s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:00:18 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=13,cinder:UPDATE=18,cinder:DELETE=1,cinder:INSERT=3 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:00:19 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=18,cinder:INSERT=7,cinder:UPDATE=17,cinder:DELETE=2 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:00:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:00:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:00:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:00:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:00:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:00:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:00:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:00:29 devstack sudo[89129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:00:29 devstack sudo[89129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:00:31 devstack sudo[89129]: pam_unix(sudo:session): session closed for user root Jul 09 10:00:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.429s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:00:31 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:00:31 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:00:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 8 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:00:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Flow 'volume_create_manager' (ad0aabcd-a76a-4f19-b751-cf076745cb22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31652144-8d44-4c35-b0ef-b4eaf0c74044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31652144-8d44-4c35-b0ef-b4eaf0c74044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-849470112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e45093a8-1537-41cf-ba43-8aa45c029ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b3eaf682af45309469243f78ee7f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:00:36Z,use_quota=True,user_id='e9ffc5fdbaf945599c510bc8766853a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ad965e-31d2-4553-82e2-4ba9eaa0b64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9ad965e-31d2-4553-82e2-4ba9eaa0b64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c6c4c9-b363-40f4-a689-cc83465ee466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07c6c4c9-b363-40f4-a689-cc83465ee466) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e45093a8-1537-41cf-ba43-8aa45c029ace', 'volume_name': 'volume-e45093a8-1537-41cf-ba43-8aa45c029ace', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e01617f-c626-46fb-ba72-8c52d02c624b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e01617f-c626-46fb-ba72-8c52d02c624b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ed3016-3c3b-4a35-b49a-b63b74ec9731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:00:35 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Volume e45093a8-1537-41cf-ba43-8aa45c029ace: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e45093a8-1537-41cf-ba43-8aa45c029ace', 'volume_size': 1} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:00:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-849470112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e45093a8-1537-41cf-ba43-8aa45c029ace,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b2b3eaf682af45309469243f78ee7f5c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:00:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:00:36Z,use_quota=True,user_id='e9ffc5fdbaf945599c510bc8766853a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Creating volume e45093a8-1537-41cf-ba43-8aa45c029ace {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:00:35 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:00:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e45093a8-1537-41cf-ba43-8aa45c029ace 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:00:35 devstack sudo[89179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e45093a8-1537-41cf-ba43-8aa45c029ace 1073741824 Jul 09 10:00:35 devstack sudo[89179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:00:37 devstack sudo[89179]: pam_unix(sudo:session): session closed for user root Jul 09 10:00:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e45093a8-1537-41cf-ba43-8aa45c029ace 1073741824" returned: 0 in 1.688s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:00:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e45093a8-1537-41cf-ba43-8aa45c029ace {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:00:37 devstack sudo[89226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e45093a8-1537-41cf-ba43-8aa45c029ace Jul 09 10:00:37 devstack sudo[89226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:00:38 devstack sudo[89226]: pam_unix(sudo:session): session closed for user root Jul 09 10:00:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e45093a8-1537-41cf-ba43-8aa45c029ace" returned: 0 in 1.104s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:00:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] <== create_volume: return (2873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:00:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.876s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:00:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9ed3016-3c3b-4a35-b49a-b63b74ec9731) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e45093a8-1537-41cf-ba43-8aa45c029ace', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:00:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246375f6-700d-45c9-94f8-ccad492207ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:00:38 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Volume volume-e45093a8-1537-41cf-ba43-8aa45c029ace (e45093a8-1537-41cf-ba43-8aa45c029ace): created successfully Jul 09 10:00:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246375f6-700d-45c9-94f8-ccad492207ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:00:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Flow 'volume_create_manager' (ad0aabcd-a76a-4f19-b751-cf076745cb22) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:00:38 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-03911258-fbbe-4746-907a-2adeeccb99ee tempest-DeleteServersTestJSON-679672631 None] Created volume successfully. Jul 09 10:00:47 devstack cinder-volume[87192]: WARNING py.warnings [req-e5fd73b0-a1be-4189-bb27-70d96b39016d req-bf8c7f3e-722a-49f2-a09a-c5831aacf19e tempest-DeleteServersTestJSON-679672631 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volumes_1". Apply join condition(s) between each element to resolve. Jul 09 10:00:47 devstack cinder-volume[87192]: .first() Jul 09 10:00:47 devstack cinder-volume[87192]: Jul 09 10:00:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-e5fd73b0-a1be-4189-bb27-70d96b39016d req-bf8c7f3e-722a-49f2-a09a-c5831aacf19e tempest-DeleteServersTestJSON-679672631 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:00:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-e5fd73b0-a1be-4189-bb27-70d96b39016d req-bf8c7f3e-722a-49f2-a09a-c5831aacf19e tempest-DeleteServersTestJSON-679672631 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:00:47 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[23e39223-8ef7-44ef-b942-d78a15f36295]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:00:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-e5fd73b0-a1be-4189-bb27-70d96b39016d req-bf8c7f3e-722a-49f2-a09a-c5831aacf19e tempest-DeleteServersTestJSON-679672631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e45093a8-1537-41cf-ba43-8aa45c029ace {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:00:47 devstack sudo[89375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e45093a8-1537-41cf-ba43-8aa45c029ace Jul 09 10:00:47 devstack sudo[89375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:00:48 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=4,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:00:49 devstack sudo[89375]: pam_unix(sudo:session): session closed for user root Jul 09 10:00:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-e5fd73b0-a1be-4189-bb27-70d96b39016d req-bf8c7f3e-722a-49f2-a09a-c5831aacf19e tempest-DeleteServersTestJSON-679672631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e45093a8-1537-41cf-ba43-8aa45c029ace" returned: 0 in 1.841s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:00:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-e5fd73b0-a1be-4189-bb27-70d96b39016d req-bf8c7f3e-722a-49f2-a09a-c5831aacf19e tempest-DeleteServersTestJSON-679672631 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.885s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:00:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-e5fd73b0-a1be-4189-bb27-70d96b39016d req-bf8c7f3e-722a-49f2-a09a-c5831aacf19e tempest-DeleteServersTestJSON-679672631 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-e45093a8-1537-41cf-ba43-8aa45c029ace', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '92244dc1-f276-46da-a60f-639ef6811621', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:00:49 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-e5fd73b0-a1be-4189-bb27-70d96b39016d req-bf8c7f3e-722a-49f2-a09a-c5831aacf19e tempest-DeleteServersTestJSON-679672631 None] attachment_update completed successfully. Jul 09 10:00:59 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-094c0df8-bcd5-46ad-b8c0-085c0efe2315 req-bf399dd3-8f39-419e-8397-1bf2360afc98 tempest-DeleteServersTestJSON-679672631 None] Terminate volume connection completed successfully. Jul 09 10:00:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-094c0df8-bcd5-46ad-b8c0-085c0efe2315 req-bf399dd3-8f39-419e-8397-1bf2360afc98 tempest-DeleteServersTestJSON-679672631 None] Deleting attachment 92244dc1-f276-46da-a60f-639ef6811621. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:01:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9e84421-eb95-4c9c-8d51-4b3f7841fad3 tempest-DeleteServersTestJSON-679672631 None] Acquiring lock "cinder-e45093a8-1537-41cf-ba43-8aa45c029ace-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:01:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9e84421-eb95-4c9c-8d51-4b3f7841fad3 tempest-DeleteServersTestJSON-679672631 None] Lock "cinder-e45093a8-1537-41cf-ba43-8aa45c029ace-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:01:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9e84421-eb95-4c9c-8d51-4b3f7841fad3 tempest-DeleteServersTestJSON-679672631 None] Acquiring lock "cinder-quobyte-e45093a8-1537-41cf-ba43-8aa45c029ace" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:01:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9e84421-eb95-4c9c-8d51-4b3f7841fad3 tempest-DeleteServersTestJSON-679672631 None] Lock "cinder-quobyte-e45093a8-1537-41cf-ba43-8aa45c029ace" acquired by "delete_volume" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:01:03 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0731b305-480b-4fc5-a283-1006e401554a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:01:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9e84421-eb95-4c9c-8d51-4b3f7841fad3 tempest-DeleteServersTestJSON-679672631 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e45093a8-1537-41cf-ba43-8aa45c029ace {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:03 devstack sudo[89942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e45093a8-1537-41cf-ba43-8aa45c029ace Jul 09 10:01:03 devstack sudo[89942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:04 devstack sudo[89942]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9e84421-eb95-4c9c-8d51-4b3f7841fad3 tempest-DeleteServersTestJSON-679672631 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e45093a8-1537-41cf-ba43-8aa45c029ace" returned: 0 in 0.877s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9e84421-eb95-4c9c-8d51-4b3f7841fad3 tempest-DeleteServersTestJSON-679672631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e45093a8-1537-41cf-ba43-8aa45c029ace {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:04 devstack sudo[89966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e45093a8-1537-41cf-ba43-8aa45c029ace Jul 09 10:01:04 devstack sudo[89966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:04 devstack sudo[89966]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9e84421-eb95-4c9c-8d51-4b3f7841fad3 tempest-DeleteServersTestJSON-679672631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e45093a8-1537-41cf-ba43-8aa45c029ace" returned: 0 in 0.756s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9e84421-eb95-4c9c-8d51-4b3f7841fad3 tempest-DeleteServersTestJSON-679672631 None] Lock "cinder-quobyte-e45093a8-1537-41cf-ba43-8aa45c029ace" released by "delete_volume" :: held 1.669s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:01:05 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d9e84421-eb95-4c9c-8d51-4b3f7841fad3 tempest-DeleteServersTestJSON-679672631 None] Created reservations ['6bd3c5aa-729e-48f7-9911-0cdcb9fac7c4', 'a0d6d58b-6048-4057-ab71-0f46438427c7', 'df6b7003-32d1-44b4-82d3-4e0c4e30b748', 'b8e53a69-f587-4d3b-b16e-d9c803ab9546'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:01:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d9e84421-eb95-4c9c-8d51-4b3f7841fad3 tempest-DeleteServersTestJSON-679672631 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d9e84421-eb95-4c9c-8d51-4b3f7841fad3 tempest-DeleteServersTestJSON-679672631 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d9e84421-eb95-4c9c-8d51-4b3f7841fad3 tempest-DeleteServersTestJSON-679672631 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:01:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d9e84421-eb95-4c9c-8d51-4b3f7841fad3 tempest-DeleteServersTestJSON-679672631 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:01:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d9e84421-eb95-4c9c-8d51-4b3f7841fad3 tempest-DeleteServersTestJSON-679672631 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9e84421-eb95-4c9c-8d51-4b3f7841fad3 tempest-DeleteServersTestJSON-679672631 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:05 devstack sudo[89974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:01:05 devstack sudo[89974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:05 devstack sudo[89974]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d9e84421-eb95-4c9c-8d51-4b3f7841fad3 tempest-DeleteServersTestJSON-679672631 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.814s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:05 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-d9e84421-eb95-4c9c-8d51-4b3f7841fad3 tempest-DeleteServersTestJSON-679672631 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:01:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d9e84421-eb95-4c9c-8d51-4b3f7841fad3 tempest-DeleteServersTestJSON-679672631 None] Deleted volume successfully. Jul 09 10:01:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d9e84421-eb95-4c9c-8d51-4b3f7841fad3 tempest-DeleteServersTestJSON-679672631 None] Lock "cinder-e45093a8-1537-41cf-ba43-8aa45c029ace-delete_volume" released by "delete_volume" :: held 2.727s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Flow 'volume_create_manager' (37d41548-d98a-4299-9180-e3b2dc911fdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a982b0d3-4f11-4186-bbd3-5cfa7bc1ce8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a982b0d3-4f11-4186-bbd3-5cfa7bc1ce8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-536359226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98f1d136-43fa-454b-8b55-4fe01edb1540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd57905db8146e69e889c3222d3516c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:01:08Z,use_quota=True,user_id='c1cd9ee3837a4b06a8afddadeaff2c42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f2449b4-d1d1-47a0-86cd-73aeba358215) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f2449b4-d1d1-47a0-86cd-73aeba358215) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11257636-8cb0-4fc3-ad84-e3a62b8a83ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11257636-8cb0-4fc3-ad84-e3a62b8a83ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98f1d136-43fa-454b-8b55-4fe01edb1540', 'volume_name': 'volume-98f1d136-43fa-454b-8b55-4fe01edb1540', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959f93d8-6430-43f0-81e7-a86c806a2176) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (959f93d8-6430-43f0-81e7-a86c806a2176) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66368640-022c-4aa1-8dcd-dde86f654826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:07 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Volume 98f1d136-43fa-454b-8b55-4fe01edb1540: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98f1d136-43fa-454b-8b55-4fe01edb1540', 'volume_size': 1} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-536359226',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98f1d136-43fa-454b-8b55-4fe01edb1540,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7fd57905db8146e69e889c3222d3516c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:01:08Z,use_quota=True,user_id='c1cd9ee3837a4b06a8afddadeaff2c42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Creating volume 98f1d136-43fa-454b-8b55-4fe01edb1540 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:01:07 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-98f1d136-43fa-454b-8b55-4fe01edb1540 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:07 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:01:07 devstack sudo[89989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-98f1d136-43fa-454b-8b55-4fe01edb1540 1073741824 Jul 09 10:01:07 devstack sudo[89989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Flow 'volume_create_manager' (b9cd5c53-5c88-42a7-9114-79ebe9590fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d92123d-718e-45d1-923e-58eefb94c70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d92123d-718e-45d1-923e-58eefb94c70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1003310294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=931fd964-b6b6-456f-8cbb-bc47c94fe2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ac5b613c0094af887e318675618607e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:01:08Z,use_quota=True,user_id='30cf46d989dd4990a3bfc0d6779fe8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ec7306-ff82-4c06-b9a2-cc83ae13fd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28ec7306-ff82-4c06-b9a2-cc83ae13fd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c413c41-85e1-4a63-887c-808e7a98b0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c413c41-85e1-4a63-887c-808e7a98b0c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '931fd964-b6b6-456f-8cbb-bc47c94fe2c6', 'volume_name': 'volume-931fd964-b6b6-456f-8cbb-bc47c94fe2c6', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba8d19ed-b0f1-489b-9001-ff8467bee904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba8d19ed-b0f1-489b-9001-ff8467bee904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8c72f1-0512-43a5-b676-cda96fc9fbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Volume 931fd964-b6b6-456f-8cbb-bc47c94fe2c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-931fd964-b6b6-456f-8cbb-bc47c94fe2c6', 'volume_size': 1} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Flow 'volume_create_manager' (24ccf0d0-9f18-4478-b9d9-3b852f0d354f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a16eee-cc50-4f35-b2aa-a2dee219e7cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63a16eee-cc50-4f35-b2aa-a2dee219e7cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-522461603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b1de4e-551f-41f6-9c4d-94e5f8244bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6535348d09554b1baacdd0035a971a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:01:09Z,use_quota=True,user_id='81895a280ee24d5e81ba3dc5ed0a3f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2324f7-881b-445e-a948-670f64e1fc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c2324f7-881b-445e-a948-670f64e1fc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad238584-b9bc-402f-afa5-8a77ec121af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad238584-b9bc-402f-afa5-8a77ec121af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25b1de4e-551f-41f6-9c4d-94e5f8244bb7', 'volume_name': 'volume-25b1de4e-551f-41f6-9c4d-94e5f8244bb7', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cace10cc-0a30-452f-826e-b0938827081d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cace10cc-0a30-452f-826e-b0938827081d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f3f8ba-c77e-427e-8aa2-5a255cd1830f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Volume 25b1de4e-551f-41f6-9c4d-94e5f8244bb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25b1de4e-551f-41f6-9c4d-94e5f8244bb7', 'volume_size': 1} Jul 09 10:01:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:09 devstack sudo[89989]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-98f1d136-43fa-454b-8b55-4fe01edb1540 1073741824" returned: 0 in 1.110s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-98f1d136-43fa-454b-8b55-4fe01edb1540 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:09 devstack sudo[89994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-98f1d136-43fa-454b-8b55-4fe01edb1540 Jul 09 10:01:09 devstack sudo[89994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:09 devstack sudo[89994]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-98f1d136-43fa-454b-8b55-4fe01edb1540" returned: 0 in 0.848s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] <== create_volume: return (2030ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:01:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.034s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.794s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:01:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1003310294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=931fd964-b6b6-456f-8cbb-bc47c94fe2c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ac5b613c0094af887e318675618607e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:01:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:01:08Z,use_quota=True,user_id='30cf46d989dd4990a3bfc0d6779fe8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:01:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Creating volume 931fd964-b6b6-456f-8cbb-bc47c94fe2c6 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:01:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:01:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:01:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:01:09 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:01:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-931fd964-b6b6-456f-8cbb-bc47c94fe2c6 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (66368640-022c-4aa1-8dcd-dde86f654826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98f1d136-43fa-454b-8b55-4fe01edb1540', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f11488-2d5b-49a9-8223-901363a3d920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:09 devstack sudo[89997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-931fd964-b6b6-456f-8cbb-bc47c94fe2c6 1073741824 Jul 09 10:01:09 devstack sudo[89997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:10 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Volume volume-98f1d136-43fa-454b-8b55-4fe01edb1540 (98f1d136-43fa-454b-8b55-4fe01edb1540): created successfully Jul 09 10:01:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f11488-2d5b-49a9-8223-901363a3d920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Flow 'volume_create_manager' (37d41548-d98a-4299-9180-e3b2dc911fdb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:01:10 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-208f9375-3778-41eb-8997-169b32f234e1 tempest-AttachVolumeShelveTestJSON-567416638 None] Created volume successfully. Jul 09 10:01:11 devstack sudo[89997]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-931fd964-b6b6-456f-8cbb-bc47c94fe2c6 1073741824" returned: 0 in 1.066s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-931fd964-b6b6-456f-8cbb-bc47c94fe2c6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:11 devstack sudo[90010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-931fd964-b6b6-456f-8cbb-bc47c94fe2c6 Jul 09 10:01:11 devstack sudo[90010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:11 devstack sudo[90010]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-931fd964-b6b6-456f-8cbb-bc47c94fe2c6" returned: 0 in 0.824s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:01:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.946s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.096s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:01:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-522461603',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25b1de4e-551f-41f6-9c4d-94e5f8244bb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6535348d09554b1baacdd0035a971a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:01:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:01:09Z,use_quota=True,user_id='81895a280ee24d5e81ba3dc5ed0a3f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:01:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Creating volume 25b1de4e-551f-41f6-9c4d-94e5f8244bb7 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:01:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:01:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:01:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:01:11 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:01:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-25b1de4e-551f-41f6-9c4d-94e5f8244bb7 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f8c72f1-0512-43a5-b676-cda96fc9fbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-931fd964-b6b6-456f-8cbb-bc47c94fe2c6', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8508f2-4868-4593-8850-2ccbefadd5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:11 devstack sudo[90013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-25b1de4e-551f-41f6-9c4d-94e5f8244bb7 1073741824 Jul 09 10:01:11 devstack sudo[90013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:11 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Volume volume-931fd964-b6b6-456f-8cbb-bc47c94fe2c6 (931fd964-b6b6-456f-8cbb-bc47c94fe2c6): created successfully Jul 09 10:01:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e8508f2-4868-4593-8850-2ccbefadd5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Flow 'volume_create_manager' (b9cd5c53-5c88-42a7-9114-79ebe9590fa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:01:12 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c0ce7762-7176-4933-a55e-da2f4cd8c4f7 tempest-VolumesActionsTest-1431754717 None] Created volume successfully. Jul 09 10:01:13 devstack sudo[90013]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f5ab95d-1041-47ba-9ad1-916db62a527f tempest-VolumesActionsTest-1431754717 None] Acquiring lock "cinder-931fd964-b6b6-456f-8cbb-bc47c94fe2c6" by "attach_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:01:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-25b1de4e-551f-41f6-9c4d-94e5f8244bb7 1073741824" returned: 0 in 1.115s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f5ab95d-1041-47ba-9ad1-916db62a527f tempest-VolumesActionsTest-1431754717 None] Lock "cinder-931fd964-b6b6-456f-8cbb-bc47c94fe2c6" acquired by "attach_volume" :: waited 0.040s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:01:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-25b1de4e-551f-41f6-9c4d-94e5f8244bb7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:13 devstack sudo[90021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-25b1de4e-551f-41f6-9c4d-94e5f8244bb7 Jul 09 10:01:13 devstack sudo[90021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:13 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3f5ab95d-1041-47ba-9ad1-916db62a527f tempest-VolumesActionsTest-1431754717 None] Attaching volume 931fd964-b6b6-456f-8cbb-bc47c94fe2c6 to instance b4e56ef0-7ecf-4c4a-a370-ee91fd68f61d at mountpoint /dev/vdb on host None. Jul 09 10:01:13 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3f5ab95d-1041-47ba-9ad1-916db62a527f tempest-VolumesActionsTest-1431754717 None] Attach volume completed successfully. Jul 09 10:01:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f5ab95d-1041-47ba-9ad1-916db62a527f tempest-VolumesActionsTest-1431754717 None] Lock "cinder-931fd964-b6b6-456f-8cbb-bc47c94fe2c6" released by "attach_volume" :: held 0.183s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:01:14 devstack sudo[90021]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-25b1de4e-551f-41f6-9c4d-94e5f8244bb7" returned: 0 in 0.937s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] <== create_volume: return (2119ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:01:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.123s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9f3f8ba-c77e-427e-8aa2-5a255cd1830f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25b1de4e-551f-41f6-9c4d-94e5f8244bb7', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82bc01b-392f-4227-92c0-20a5fe28f5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:14 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Volume volume-25b1de4e-551f-41f6-9c4d-94e5f8244bb7 (25b1de4e-551f-41f6-9c4d-94e5f8244bb7): created successfully Jul 09 10:01:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a82bc01b-392f-4227-92c0-20a5fe28f5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Flow 'volume_create_manager' (24ccf0d0-9f18-4478-b9d9-3b852f0d354f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:01:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0dc5f8e2-d433-4445-9cf9-a1f6ad8b4340 tempest-AttachVolumeTestJSON-1815239661 None] Created volume successfully. Jul 09 10:01:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-04596988-bdd3-4dbb-b9c1-d0cf4b3bdf4a tempest-VolumesActionsTest-27274016 None] Terminate volume connection completed successfully. Jul 09 10:01:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-04596988-bdd3-4dbb-b9c1-d0cf4b3bdf4a tempest-VolumesActionsTest-27274016 None] Acquiring lock "cinder-931fd964-b6b6-456f-8cbb-bc47c94fe2c6-detach_volume" by "detach_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:01:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-04596988-bdd3-4dbb-b9c1-d0cf4b3bdf4a tempest-VolumesActionsTest-27274016 None] Lock "cinder-931fd964-b6b6-456f-8cbb-bc47c94fe2c6-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:01:15 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-04596988-bdd3-4dbb-b9c1-d0cf4b3bdf4a tempest-VolumesActionsTest-27274016 None] Detaching volume 931fd964-b6b6-456f-8cbb-bc47c94fe2c6 from instance b4e56ef0-7ecf-4c4a-a370-ee91fd68f61d. Jul 09 10:01:15 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-04596988-bdd3-4dbb-b9c1-d0cf4b3bdf4a tempest-VolumesActionsTest-27274016 None] Detach volume completed successfully. Jul 09 10:01:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-04596988-bdd3-4dbb-b9c1-d0cf4b3bdf4a tempest-VolumesActionsTest-27274016 None] Lock "cinder-931fd964-b6b6-456f-8cbb-bc47c94fe2c6-detach_volume" released by "detach_volume" :: held 0.082s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:01:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c773b10a-ff78-412b-beed-5fb03ea3fddb tempest-VolumesActionsTest-1431754717 None] Acquiring lock "cinder-931fd964-b6b6-456f-8cbb-bc47c94fe2c6-detach_volume" by "detach_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:01:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c773b10a-ff78-412b-beed-5fb03ea3fddb tempest-VolumesActionsTest-1431754717 None] Lock "cinder-931fd964-b6b6-456f-8cbb-bc47c94fe2c6-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:01:16 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c773b10a-ff78-412b-beed-5fb03ea3fddb tempest-VolumesActionsTest-1431754717 None] Volume detach called, but volume not attached. Jul 09 10:01:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c773b10a-ff78-412b-beed-5fb03ea3fddb tempest-VolumesActionsTest-1431754717 None] Lock "cinder-931fd964-b6b6-456f-8cbb-bc47c94fe2c6-detach_volume" released by "detach_volume" :: held 0.024s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:01:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3ee90bc-619f-402c-b2f0-2c5fea9e97c0 tempest-VolumesActionsTest-1431754717 None] Acquiring lock "cinder-931fd964-b6b6-456f-8cbb-bc47c94fe2c6-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:01:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3ee90bc-619f-402c-b2f0-2c5fea9e97c0 tempest-VolumesActionsTest-1431754717 None] Lock "cinder-931fd964-b6b6-456f-8cbb-bc47c94fe2c6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:01:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3ee90bc-619f-402c-b2f0-2c5fea9e97c0 tempest-VolumesActionsTest-1431754717 None] Acquiring lock "cinder-quobyte-931fd964-b6b6-456f-8cbb-bc47c94fe2c6" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:01:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3ee90bc-619f-402c-b2f0-2c5fea9e97c0 tempest-VolumesActionsTest-1431754717 None] Lock "cinder-quobyte-931fd964-b6b6-456f-8cbb-bc47c94fe2c6" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:01:16 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b7d157-8ee0-4eb8-9812-c69193994101]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:01:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3ee90bc-619f-402c-b2f0-2c5fea9e97c0 tempest-VolumesActionsTest-1431754717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-931fd964-b6b6-456f-8cbb-bc47c94fe2c6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:17 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-931fd964-b6b6-456f-8cbb-bc47c94fe2c6 Jul 09 10:01:17 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:18 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3ee90bc-619f-402c-b2f0-2c5fea9e97c0 tempest-VolumesActionsTest-1431754717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-931fd964-b6b6-456f-8cbb-bc47c94fe2c6" returned: 0 in 1.144s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3ee90bc-619f-402c-b2f0-2c5fea9e97c0 tempest-VolumesActionsTest-1431754717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-931fd964-b6b6-456f-8cbb-bc47c94fe2c6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:18 devstack sudo[90063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-931fd964-b6b6-456f-8cbb-bc47c94fe2c6 Jul 09 10:01:18 devstack sudo[90063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-60aa59e9-5d53-4f1a-bfcd-86184dc71182 req-8eb3b03c-e3e4-48ab-a830-2f7ff3545774 tempest-AttachVolumeTestJSON-1815239661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-60aa59e9-5d53-4f1a-bfcd-86184dc71182 req-8eb3b03c-e3e4-48ab-a830-2f7ff3545774 tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:18 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0943f499-872d-4868-98fd-ba2295936509]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:01:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-60aa59e9-5d53-4f1a-bfcd-86184dc71182 req-8eb3b03c-e3e4-48ab-a830-2f7ff3545774 tempest-AttachVolumeTestJSON-1815239661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-25b1de4e-551f-41f6-9c4d-94e5f8244bb7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:18 devstack sudo[90073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-25b1de4e-551f-41f6-9c4d-94e5f8244bb7 Jul 09 10:01:18 devstack sudo[90073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:19 devstack sudo[90063]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3ee90bc-619f-402c-b2f0-2c5fea9e97c0 tempest-VolumesActionsTest-1431754717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-931fd964-b6b6-456f-8cbb-bc47c94fe2c6" returned: 0 in 1.037s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3ee90bc-619f-402c-b2f0-2c5fea9e97c0 tempest-VolumesActionsTest-1431754717 None] Lock "cinder-quobyte-931fd964-b6b6-456f-8cbb-bc47c94fe2c6" released by "delete_volume" :: held 2.255s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:01:19 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a3ee90bc-619f-402c-b2f0-2c5fea9e97c0 tempest-VolumesActionsTest-1431754717 None] Created reservations ['31f72707-01d8-4b06-8ab8-830c9afa132d', '92ef55f9-710f-4346-aefc-6c09bd81ea19', '005644bc-937d-4eb5-a2e5-7a01d521f7c4', '6412cc11-fc09-4bb9-8285-a2ce3aa31b14'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:01:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a3ee90bc-619f-402c-b2f0-2c5fea9e97c0 tempest-VolumesActionsTest-1431754717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a3ee90bc-619f-402c-b2f0-2c5fea9e97c0 tempest-VolumesActionsTest-1431754717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee90bc-619f-402c-b2f0-2c5fea9e97c0 tempest-VolumesActionsTest-1431754717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:01:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a3ee90bc-619f-402c-b2f0-2c5fea9e97c0 tempest-VolumesActionsTest-1431754717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:01:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a3ee90bc-619f-402c-b2f0-2c5fea9e97c0 tempest-VolumesActionsTest-1431754717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3ee90bc-619f-402c-b2f0-2c5fea9e97c0 tempest-VolumesActionsTest-1431754717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:19 devstack sudo[90076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:01:19 devstack sudo[90076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:19 devstack sudo[90073]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-60aa59e9-5d53-4f1a-bfcd-86184dc71182 req-8eb3b03c-e3e4-48ab-a830-2f7ff3545774 tempest-AttachVolumeTestJSON-1815239661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-25b1de4e-551f-41f6-9c4d-94e5f8244bb7" returned: 0 in 1.282s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-60aa59e9-5d53-4f1a-bfcd-86184dc71182 req-8eb3b03c-e3e4-48ab-a830-2f7ff3545774 tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.301s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-60aa59e9-5d53-4f1a-bfcd-86184dc71182 req-8eb3b03c-e3e4-48ab-a830-2f7ff3545774 tempest-AttachVolumeTestJSON-1815239661 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-25b1de4e-551f-41f6-9c4d-94e5f8244bb7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '30b1c437-b441-41e4-b98e-d46b14194795', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:01:19 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-60aa59e9-5d53-4f1a-bfcd-86184dc71182 req-8eb3b03c-e3e4-48ab-a830-2f7ff3545774 tempest-AttachVolumeTestJSON-1815239661 None] attachment_update completed successfully. Jul 09 10:01:20 devstack sudo[90076]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3ee90bc-619f-402c-b2f0-2c5fea9e97c0 tempest-VolumesActionsTest-1431754717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.022s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:20 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a3ee90bc-619f-402c-b2f0-2c5fea9e97c0 tempest-VolumesActionsTest-1431754717 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:01:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a3ee90bc-619f-402c-b2f0-2c5fea9e97c0 tempest-VolumesActionsTest-1431754717 None] Deleted volume successfully. Jul 09 10:01:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3ee90bc-619f-402c-b2f0-2c5fea9e97c0 tempest-VolumesActionsTest-1431754717 None] Lock "cinder-931fd964-b6b6-456f-8cbb-bc47c94fe2c6-delete_volume" released by "delete_volume" :: held 3.661s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Flow 'volume_create_manager' (6a13eda1-7010-4564-b249-4f28feb0fcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd55d2dc-512c-4470-b05c-17a51b7609e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd55d2dc-512c-4470-b05c-17a51b7609e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1438708085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f938a9a-8491-44a7-ab76-b774ed64e9fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ac5b613c0094af887e318675618607e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:01:28Z,use_quota=True,user_id='30cf46d989dd4990a3bfc0d6779fe8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17897e79-d49e-4cf0-a3b6-d939a9f195d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17897e79-d49e-4cf0-a3b6-d939a9f195d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8bba410-7a23-480a-9eb5-43f9fac28140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d8bba410-7a23-480a-9eb5-43f9fac28140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f938a9a-8491-44a7-ab76-b774ed64e9fa', 'volume_name': 'volume-0f938a9a-8491-44a7-ab76-b774ed64e9fa', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f2ddc6-fc52-49d4-9939-86999810fb30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (20f2ddc6-fc52-49d4-9939-86999810fb30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc7830e-e1ce-404a-85fb-5b2f34b50958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:27 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Volume 0f938a9a-8491-44a7-ab76-b774ed64e9fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f938a9a-8491-44a7-ab76-b774ed64e9fa', 'volume_size': 1} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:01:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1438708085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f938a9a-8491-44a7-ab76-b774ed64e9fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ac5b613c0094af887e318675618607e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:01:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:01:28Z,use_quota=True,user_id='30cf46d989dd4990a3bfc0d6779fe8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Creating volume 0f938a9a-8491-44a7-ab76-b774ed64e9fa {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:01:27 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:01:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0f938a9a-8491-44a7-ab76-b774ed64e9fa 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:28 devstack sudo[90553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0f938a9a-8491-44a7-ab76-b774ed64e9fa 1073741824 Jul 09 10:01:28 devstack sudo[90553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:29 devstack sudo[90553]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0f938a9a-8491-44a7-ab76-b774ed64e9fa 1073741824" returned: 0 in 1.061s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0f938a9a-8491-44a7-ab76-b774ed64e9fa {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:29 devstack sudo[90560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0f938a9a-8491-44a7-ab76-b774ed64e9fa Jul 09 10:01:29 devstack sudo[90560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:29 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=34,cinder:SELECT=38,cinder:INSERT=8,cinder:DELETE=2 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:01:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-73516058-5881-44f5-9cf5-bf71ad998aff req-46e20eaf-5810-4928-b6dc-8353a5b50de9 tempest-AttachVolumeShelveTestJSON-567416638 None] No connector for attachment 707e4a74-09d7-4dde-8d4e-d5629aa02d93; skipping storage backend terminate_connection call. {{(pid=87192) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 09 10:01:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-73516058-5881-44f5-9cf5-bf71ad998aff req-46e20eaf-5810-4928-b6dc-8353a5b50de9 tempest-AttachVolumeShelveTestJSON-567416638 None] Deleting attachment 707e4a74-09d7-4dde-8d4e-d5629aa02d93. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:01:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:01:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 8 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:01:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:01:29 devstack sudo[90560]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0f938a9a-8491-44a7-ab76-b774ed64e9fa" returned: 0 in 0.843s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] <== create_volume: return (1957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:01:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.960s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbc7830e-e1ce-404a-85fb-5b2f34b50958) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f938a9a-8491-44a7-ab76-b774ed64e9fa', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53da672-98ab-4dd2-ae38-b589fc943310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:29 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Volume volume-0f938a9a-8491-44a7-ab76-b774ed64e9fa (0f938a9a-8491-44a7-ab76-b774ed64e9fa): created successfully Jul 09 10:01:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f53da672-98ab-4dd2-ae38-b589fc943310) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Flow 'volume_create_manager' (6a13eda1-7010-4564-b249-4f28feb0fcf5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:01:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c50463c8-90b1-4725-9534-6ef21001b67d tempest-VolumesActionsTest-1431754717 None] Created volume successfully. Jul 09 10:01:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2339d1bf-78d8-4766-8ace-8c17f141cc52 tempest-VolumesActionsTest-27274016 None] Acquiring lock "cinder-0f938a9a-8491-44a7-ab76-b774ed64e9fa-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:01:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2339d1bf-78d8-4766-8ace-8c17f141cc52 tempest-VolumesActionsTest-27274016 None] Lock "cinder-0f938a9a-8491-44a7-ab76-b774ed64e9fa-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:01:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2339d1bf-78d8-4766-8ace-8c17f141cc52 tempest-VolumesActionsTest-27274016 None] Acquiring lock "cinder-quobyte-0f938a9a-8491-44a7-ab76-b774ed64e9fa" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:01:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2339d1bf-78d8-4766-8ace-8c17f141cc52 tempest-VolumesActionsTest-27274016 None] Lock "cinder-quobyte-0f938a9a-8491-44a7-ab76-b774ed64e9fa" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:01:31 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5fb93f0-2330-4d23-89d9-f1db52f925a8]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:01:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2339d1bf-78d8-4766-8ace-8c17f141cc52 tempest-VolumesActionsTest-27274016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0f938a9a-8491-44a7-ab76-b774ed64e9fa {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:31 devstack sudo[90565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0f938a9a-8491-44a7-ab76-b774ed64e9fa Jul 09 10:01:31 devstack sudo[90565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:32 devstack sudo[90565]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2339d1bf-78d8-4766-8ace-8c17f141cc52 tempest-VolumesActionsTest-27274016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0f938a9a-8491-44a7-ab76-b774ed64e9fa" returned: 0 in 1.196s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2339d1bf-78d8-4766-8ace-8c17f141cc52 tempest-VolumesActionsTest-27274016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0f938a9a-8491-44a7-ab76-b774ed64e9fa {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:32 devstack sudo[90584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0f938a9a-8491-44a7-ab76-b774ed64e9fa Jul 09 10:01:32 devstack sudo[90584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:33 devstack sudo[90584]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2339d1bf-78d8-4766-8ace-8c17f141cc52 tempest-VolumesActionsTest-27274016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0f938a9a-8491-44a7-ab76-b774ed64e9fa" returned: 0 in 0.793s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2339d1bf-78d8-4766-8ace-8c17f141cc52 tempest-VolumesActionsTest-27274016 None] Lock "cinder-quobyte-0f938a9a-8491-44a7-ab76-b774ed64e9fa" released by "delete_volume" :: held 2.043s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:01:33 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-2339d1bf-78d8-4766-8ace-8c17f141cc52 tempest-VolumesActionsTest-27274016 None] Created reservations ['3cdcb271-0b4d-4c5f-8e46-fc556da2c4c8', 'af988164-cd93-431d-a4a3-664585d6653c', '1d069c48-15d1-4d4c-83a1-4daa0534a080', '9892569d-e9ab-490f-81af-d0be9cebe091'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:01:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2339d1bf-78d8-4766-8ace-8c17f141cc52 tempest-VolumesActionsTest-27274016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2339d1bf-78d8-4766-8ace-8c17f141cc52 tempest-VolumesActionsTest-27274016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2339d1bf-78d8-4766-8ace-8c17f141cc52 tempest-VolumesActionsTest-27274016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:01:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2339d1bf-78d8-4766-8ace-8c17f141cc52 tempest-VolumesActionsTest-27274016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:01:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2339d1bf-78d8-4766-8ace-8c17f141cc52 tempest-VolumesActionsTest-27274016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2339d1bf-78d8-4766-8ace-8c17f141cc52 tempest-VolumesActionsTest-27274016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:33 devstack sudo[90594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:01:33 devstack sudo[90594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:34 devstack sudo[90594]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2339d1bf-78d8-4766-8ace-8c17f141cc52 tempest-VolumesActionsTest-27274016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.939s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:34 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-2339d1bf-78d8-4766-8ace-8c17f141cc52 tempest-VolumesActionsTest-27274016 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:01:34 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2339d1bf-78d8-4766-8ace-8c17f141cc52 tempest-VolumesActionsTest-27274016 None] Deleted volume successfully. Jul 09 10:01:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2339d1bf-78d8-4766-8ace-8c17f141cc52 tempest-VolumesActionsTest-27274016 None] Lock "cinder-0f938a9a-8491-44a7-ab76-b774ed64e9fa-delete_volume" released by "delete_volume" :: held 3.246s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Flow 'volume_create_manager' (4cd94e57-9c41-4f50-8747-983cd9d239ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccbce80-2194-447a-b33a-3eb2a8e3764c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccbce80-2194-447a-b33a-3eb2a8e3764c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-904742104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de27a2c-d10e-473e-b4d6-e4061ef808f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ac5b613c0094af887e318675618607e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:01:35Z,use_quota=True,user_id='30cf46d989dd4990a3bfc0d6779fe8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8a9136-6557-448b-96f3-47b82a6c4a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ae8a9136-6557-448b-96f3-47b82a6c4a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c353f2ef-6a05-43e5-b3df-64563110ea78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c353f2ef-6a05-43e5-b3df-64563110ea78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7de27a2c-d10e-473e-b4d6-e4061ef808f5', 'volume_name': 'volume-7de27a2c-d10e-473e-b4d6-e4061ef808f5', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0bdce4-982f-4631-ae6c-5ae8d313f5e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0bdce4-982f-4631-ae6c-5ae8d313f5e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee50d5b-a6e0-419a-b1b5-e6f2355414a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:35 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Volume 7de27a2c-d10e-473e-b4d6-e4061ef808f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7de27a2c-d10e-473e-b4d6-e4061ef808f5', 'volume_size': 1} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:01:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-904742104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7de27a2c-d10e-473e-b4d6-e4061ef808f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ac5b613c0094af887e318675618607e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:01:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:01:35Z,use_quota=True,user_id='30cf46d989dd4990a3bfc0d6779fe8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Creating volume 7de27a2c-d10e-473e-b4d6-e4061ef808f5 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:01:35 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:01:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7de27a2c-d10e-473e-b4d6-e4061ef808f5 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:35 devstack sudo[90699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7de27a2c-d10e-473e-b4d6-e4061ef808f5 1073741824 Jul 09 10:01:35 devstack sudo[90699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:36 devstack sudo[90699]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7de27a2c-d10e-473e-b4d6-e4061ef808f5 1073741824" returned: 0 in 1.057s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7de27a2c-d10e-473e-b4d6-e4061ef808f5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:36 devstack sudo[90713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7de27a2c-d10e-473e-b4d6-e4061ef808f5 Jul 09 10:01:36 devstack sudo[90713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:37 devstack sudo[90713]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7de27a2c-d10e-473e-b4d6-e4061ef808f5" returned: 0 in 0.741s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] <== create_volume: return (1860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:01:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.863s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee50d5b-a6e0-419a-b1b5-e6f2355414a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7de27a2c-d10e-473e-b4d6-e4061ef808f5', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83691e5-b9db-456a-baed-062452152658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:37 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Volume volume-7de27a2c-d10e-473e-b4d6-e4061ef808f5 (7de27a2c-d10e-473e-b4d6-e4061ef808f5): created successfully Jul 09 10:01:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c83691e5-b9db-456a-baed-062452152658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Flow 'volume_create_manager' (4cd94e57-9c41-4f50-8747-983cd9d239ec) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:01:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-aec8099f-9254-4f22-b276-0b381029660e tempest-VolumesActionsTest-1431754717 None] Created volume successfully. Jul 09 10:01:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-30ade19c-f70c-469c-80df-0c77841f770a tempest-VolumesActionsTest-27274016 None] Acquiring lock "cinder-7de27a2c-d10e-473e-b4d6-e4061ef808f5-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:01:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-30ade19c-f70c-469c-80df-0c77841f770a tempest-VolumesActionsTest-27274016 None] Lock "cinder-7de27a2c-d10e-473e-b4d6-e4061ef808f5-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:01:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-30ade19c-f70c-469c-80df-0c77841f770a tempest-VolumesActionsTest-27274016 None] Acquiring lock "cinder-quobyte-7de27a2c-d10e-473e-b4d6-e4061ef808f5" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:01:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-30ade19c-f70c-469c-80df-0c77841f770a tempest-VolumesActionsTest-27274016 None] Lock "cinder-quobyte-7de27a2c-d10e-473e-b4d6-e4061ef808f5" acquired by "delete_volume" :: waited 0.032s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:01:39 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[db5a4172-8efa-4d7f-98f9-a18496b97754]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:01:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-30ade19c-f70c-469c-80df-0c77841f770a tempest-VolumesActionsTest-27274016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7de27a2c-d10e-473e-b4d6-e4061ef808f5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:39 devstack sudo[91101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7de27a2c-d10e-473e-b4d6-e4061ef808f5 Jul 09 10:01:39 devstack sudo[91101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:40 devstack sudo[91101]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-30ade19c-f70c-469c-80df-0c77841f770a tempest-VolumesActionsTest-27274016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7de27a2c-d10e-473e-b4d6-e4061ef808f5" returned: 0 in 1.172s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-30ade19c-f70c-469c-80df-0c77841f770a tempest-VolumesActionsTest-27274016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7de27a2c-d10e-473e-b4d6-e4061ef808f5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:40 devstack sudo[91108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7de27a2c-d10e-473e-b4d6-e4061ef808f5 Jul 09 10:01:40 devstack sudo[91108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:41 devstack sudo[91108]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-30ade19c-f70c-469c-80df-0c77841f770a tempest-VolumesActionsTest-27274016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7de27a2c-d10e-473e-b4d6-e4061ef808f5" returned: 0 in 1.122s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-30ade19c-f70c-469c-80df-0c77841f770a tempest-VolumesActionsTest-27274016 None] Lock "cinder-quobyte-7de27a2c-d10e-473e-b4d6-e4061ef808f5" released by "delete_volume" :: held 2.388s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:01:41 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-30ade19c-f70c-469c-80df-0c77841f770a tempest-VolumesActionsTest-27274016 None] Created reservations ['4e9c3268-af43-491a-b51f-09571f314227', '33869e88-c816-466b-ae90-1cfd8afa030f', '50cb53e6-c8eb-47d6-a0d4-fb7a9946763b', '70626c04-bd1b-4f49-8761-b0ec08d79940'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:01:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-30ade19c-f70c-469c-80df-0c77841f770a tempest-VolumesActionsTest-27274016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-30ade19c-f70c-469c-80df-0c77841f770a tempest-VolumesActionsTest-27274016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-30ade19c-f70c-469c-80df-0c77841f770a tempest-VolumesActionsTest-27274016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:01:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-30ade19c-f70c-469c-80df-0c77841f770a tempest-VolumesActionsTest-27274016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:01:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-30ade19c-f70c-469c-80df-0c77841f770a tempest-VolumesActionsTest-27274016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-30ade19c-f70c-469c-80df-0c77841f770a tempest-VolumesActionsTest-27274016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:41 devstack sudo[91120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:01:41 devstack sudo[91120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:42 devstack sudo[91120]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-30ade19c-f70c-469c-80df-0c77841f770a tempest-VolumesActionsTest-27274016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.763s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:42 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-30ade19c-f70c-469c-80df-0c77841f770a tempest-VolumesActionsTest-27274016 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:01:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-30ade19c-f70c-469c-80df-0c77841f770a tempest-VolumesActionsTest-27274016 None] Deleted volume successfully. Jul 09 10:01:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-30ade19c-f70c-469c-80df-0c77841f770a tempest-VolumesActionsTest-27274016 None] Lock "cinder-7de27a2c-d10e-473e-b4d6-e4061ef808f5-delete_volume" released by "delete_volume" :: held 3.483s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Flow 'volume_create_manager' (14c72828-d82d-4bd2-b6ba-4d1dfa719ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40538f7-0ffc-48e4-86ca-a37dea93e228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40538f7-0ffc-48e4-86ca-a37dea93e228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1662140265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9a458a-7310-4e8b-b88a-28ec9678e685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ac5b613c0094af887e318675618607e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:01:43Z,use_quota=True,user_id='30cf46d989dd4990a3bfc0d6779fe8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b43e7b5-bc76-4547-88a7-00be21214fc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b43e7b5-bc76-4547-88a7-00be21214fc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0ed90f-1d49-46f0-a224-57af92ed1e1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c0ed90f-1d49-46f0-a224-57af92ed1e1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db9a458a-7310-4e8b-b88a-28ec9678e685', 'volume_name': 'volume-db9a458a-7310-4e8b-b88a-28ec9678e685', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ada512-b451-4bda-82cd-cdcaf3a0bf4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88ada512-b451-4bda-82cd-cdcaf3a0bf4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98949444-54dd-4c2d-9e9b-4ba15566ee8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:43 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Volume db9a458a-7310-4e8b-b88a-28ec9678e685: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db9a458a-7310-4e8b-b88a-28ec9678e685', 'volume_size': 1} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1662140265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db9a458a-7310-4e8b-b88a-28ec9678e685,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ac5b613c0094af887e318675618607e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:01:43Z,use_quota=True,user_id='30cf46d989dd4990a3bfc0d6779fe8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Creating volume db9a458a-7310-4e8b-b88a-28ec9678e685 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:01:43 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db9a458a-7310-4e8b-b88a-28ec9678e685 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:43 devstack sudo[91124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db9a458a-7310-4e8b-b88a-28ec9678e685 1073741824 Jul 09 10:01:43 devstack sudo[91124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Flow 'volume_create_manager' (653ad8aa-a886-4da7-ace5-2ef6725745c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23ae2f0-056d-41bf-b2dd-fd36aae2313c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23ae2f0-056d-41bf-b2dd-fd36aae2313c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1285411057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b181a6b8-efc1-4603-9e71-25c44ec43953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd9b5ed04da41bcaa16e07f7fd2a4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:01:43Z,use_quota=True,user_id='4ffdd9b4185144ad9fcec5a3477b8936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672577a9-25f9-4eb7-baba-3cc08720d76c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (672577a9-25f9-4eb7-baba-3cc08720d76c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b29cca8-c77e-4194-9c3e-9b06f9527853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b29cca8-c77e-4194-9c3e-9b06f9527853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b181a6b8-efc1-4603-9e71-25c44ec43953', 'volume_name': 'volume-b181a6b8-efc1-4603-9e71-25c44ec43953', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ee7b4b-b2f5-481b-b070-7ef11644a835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59ee7b4b-b2f5-481b-b070-7ef11644a835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0908748a-6664-4bda-9ed8-05acb442a37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:43 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Volume b181a6b8-efc1-4603-9e71-25c44ec43953: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b181a6b8-efc1-4603-9e71-25c44ec43953', 'volume_size': 1} Jul 09 10:01:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:44 devstack sudo[91124]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db9a458a-7310-4e8b-b88a-28ec9678e685 1073741824" returned: 0 in 1.012s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db9a458a-7310-4e8b-b88a-28ec9678e685 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:44 devstack sudo[91131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db9a458a-7310-4e8b-b88a-28ec9678e685 Jul 09 10:01:44 devstack sudo[91131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:44 devstack sudo[91131]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db9a458a-7310-4e8b-b88a-28ec9678e685" returned: 0 in 0.694s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:01:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.410s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:01:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1285411057',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b181a6b8-efc1-4603-9e71-25c44ec43953,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2fd9b5ed04da41bcaa16e07f7fd2a4e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:01:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:01:43Z,use_quota=True,user_id='4ffdd9b4185144ad9fcec5a3477b8936',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:01:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Creating volume b181a6b8-efc1-4603-9e71-25c44ec43953 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:01:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:01:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:01:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:01:44 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:01:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b181a6b8-efc1-4603-9e71-25c44ec43953 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:45 devstack sudo[91134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b181a6b8-efc1-4603-9e71-25c44ec43953 1073741824 Jul 09 10:01:45 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98949444-54dd-4c2d-9e9b-4ba15566ee8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db9a458a-7310-4e8b-b88a-28ec9678e685', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a1c07b-370f-4539-b0dd-0f005a733414) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:45 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Volume volume-db9a458a-7310-4e8b-b88a-28ec9678e685 (db9a458a-7310-4e8b-b88a-28ec9678e685): created successfully Jul 09 10:01:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0a1c07b-370f-4539-b0dd-0f005a733414) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Flow 'volume_create_manager' (14c72828-d82d-4bd2-b6ba-4d1dfa719ef4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:01:45 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-759bcb37-3268-4f7c-b732-e0a1121f06ab tempest-VolumesActionsTest-1431754717 None] Created volume successfully. Jul 09 10:01:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-12445d77-ad51-4ca4-a117-d2727960ddbf tempest-VolumesActionsTest-27274016 None] Acquiring lock "cinder-db9a458a-7310-4e8b-b88a-28ec9678e685-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:01:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-12445d77-ad51-4ca4-a117-d2727960ddbf tempest-VolumesActionsTest-27274016 None] Lock "cinder-db9a458a-7310-4e8b-b88a-28ec9678e685-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:01:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-12445d77-ad51-4ca4-a117-d2727960ddbf tempest-VolumesActionsTest-27274016 None] Acquiring lock "cinder-quobyte-db9a458a-7310-4e8b-b88a-28ec9678e685" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:01:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-12445d77-ad51-4ca4-a117-d2727960ddbf tempest-VolumesActionsTest-27274016 None] Lock "cinder-quobyte-db9a458a-7310-4e8b-b88a-28ec9678e685" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:01:45 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c212fbf-5ca1-484f-9701-50060f6281b9]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:01:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-12445d77-ad51-4ca4-a117-d2727960ddbf tempest-VolumesActionsTest-27274016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db9a458a-7310-4e8b-b88a-28ec9678e685 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:45 devstack sudo[91149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db9a458a-7310-4e8b-b88a-28ec9678e685 Jul 09 10:01:45 devstack sudo[91149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:46 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b181a6b8-efc1-4603-9e71-25c44ec43953 1073741824" returned: 0 in 1.515s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b181a6b8-efc1-4603-9e71-25c44ec43953 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:46 devstack sudo[91175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b181a6b8-efc1-4603-9e71-25c44ec43953 Jul 09 10:01:46 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:46 devstack sudo[91149]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-12445d77-ad51-4ca4-a117-d2727960ddbf tempest-VolumesActionsTest-27274016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db9a458a-7310-4e8b-b88a-28ec9678e685" returned: 0 in 1.173s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-12445d77-ad51-4ca4-a117-d2727960ddbf tempest-VolumesActionsTest-27274016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db9a458a-7310-4e8b-b88a-28ec9678e685 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:46 devstack sudo[91178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db9a458a-7310-4e8b-b88a-28ec9678e685 Jul 09 10:01:46 devstack sudo[91178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:47 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b181a6b8-efc1-4603-9e71-25c44ec43953" returned: 0 in 0.865s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] <== create_volume: return (2449ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:01:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.453s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0908748a-6664-4bda-9ed8-05acb442a37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b181a6b8-efc1-4603-9e71-25c44ec43953', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7841f666-dee7-4cb1-8037-e3497d33d79a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:47 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Volume volume-b181a6b8-efc1-4603-9e71-25c44ec43953 (b181a6b8-efc1-4603-9e71-25c44ec43953): created successfully Jul 09 10:01:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7841f666-dee7-4cb1-8037-e3497d33d79a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Flow 'volume_create_manager' (653ad8aa-a886-4da7-ace5-2ef6725745c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:01:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5cf98892-1603-47ac-807e-80eeba98ef78 tempest-TaggedAttachmentsTest-420306876 None] Created volume successfully. Jul 09 10:01:47 devstack sudo[91178]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-12445d77-ad51-4ca4-a117-d2727960ddbf tempest-VolumesActionsTest-27274016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db9a458a-7310-4e8b-b88a-28ec9678e685" returned: 0 in 0.934s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-12445d77-ad51-4ca4-a117-d2727960ddbf tempest-VolumesActionsTest-27274016 None] Lock "cinder-quobyte-db9a458a-7310-4e8b-b88a-28ec9678e685" released by "delete_volume" :: held 2.176s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:01:47 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-12445d77-ad51-4ca4-a117-d2727960ddbf tempest-VolumesActionsTest-27274016 None] Created reservations ['b2c42658-4a82-4d69-b58d-d12ca9e4e731', 'a1d72e0d-af0d-46e4-83ff-116808fe2fd2', 'c3d5e752-e59f-4096-a46a-0b3f27878c34', 'b5242de1-2416-4e8e-a71c-31cea8e606bd'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:01:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-12445d77-ad51-4ca4-a117-d2727960ddbf tempest-VolumesActionsTest-27274016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-12445d77-ad51-4ca4-a117-d2727960ddbf tempest-VolumesActionsTest-27274016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-12445d77-ad51-4ca4-a117-d2727960ddbf tempest-VolumesActionsTest-27274016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:01:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-12445d77-ad51-4ca4-a117-d2727960ddbf tempest-VolumesActionsTest-27274016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:01:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-12445d77-ad51-4ca4-a117-d2727960ddbf tempest-VolumesActionsTest-27274016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-12445d77-ad51-4ca4-a117-d2727960ddbf tempest-VolumesActionsTest-27274016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:48 devstack sudo[91191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:01:48 devstack sudo[91191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:49 devstack sudo[91191]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-12445d77-ad51-4ca4-a117-d2727960ddbf tempest-VolumesActionsTest-27274016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.155s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-12445d77-ad51-4ca4-a117-d2727960ddbf tempest-VolumesActionsTest-27274016 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:01:49 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-12445d77-ad51-4ca4-a117-d2727960ddbf tempest-VolumesActionsTest-27274016 None] Deleted volume successfully. Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-12445d77-ad51-4ca4-a117-d2727960ddbf tempest-VolumesActionsTest-27274016 None] Lock "cinder-db9a458a-7310-4e8b-b88a-28ec9678e685-delete_volume" released by "delete_volume" :: held 3.746s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=59,cinder:UPDATE=68,cinder:INSERT=15,cinder:DELETE=6 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Flow 'volume_create_manager' (e93f0a4c-248f-45e8-b28e-08a4214b0677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25e8fbf-bef3-4322-b90c-b095fa432b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e25e8fbf-bef3-4322-b90c-b095fa432b79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1433322539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1376dcdf-8fa7-4258-aad1-defd2e6e80a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ac5b613c0094af887e318675618607e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:01:50Z,use_quota=True,user_id='30cf46d989dd4990a3bfc0d6779fe8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1740034-b593-4b0d-b811-6aeb59d3e8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1740034-b593-4b0d-b811-6aeb59d3e8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9356898-01bb-4ba0-b3ed-3d2250e7a805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9356898-01bb-4ba0-b3ed-3d2250e7a805) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1376dcdf-8fa7-4258-aad1-defd2e6e80a5', 'volume_name': 'volume-1376dcdf-8fa7-4258-aad1-defd2e6e80a5', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4186512-44b2-43b2-823b-c94a7ce7dbf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4186512-44b2-43b2-823b-c94a7ce7dbf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1af75d-cc5e-4078-8eb7-1b380c39cf94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:49 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Volume 1376dcdf-8fa7-4258-aad1-defd2e6e80a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1376dcdf-8fa7-4258-aad1-defd2e6e80a5', 'volume_size': 1} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:01:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1433322539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1376dcdf-8fa7-4258-aad1-defd2e6e80a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ac5b613c0094af887e318675618607e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:01:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:01:50Z,use_quota=True,user_id='30cf46d989dd4990a3bfc0d6779fe8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Creating volume 1376dcdf-8fa7-4258-aad1-defd2e6e80a5 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:01:49 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:01:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1376dcdf-8fa7-4258-aad1-defd2e6e80a5 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:49 devstack sudo[91196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1376dcdf-8fa7-4258-aad1-defd2e6e80a5 1073741824 Jul 09 10:01:49 devstack sudo[91196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:51 devstack sudo[91196]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1376dcdf-8fa7-4258-aad1-defd2e6e80a5 1073741824" returned: 0 in 1.247s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1376dcdf-8fa7-4258-aad1-defd2e6e80a5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:51 devstack sudo[91234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1376dcdf-8fa7-4258-aad1-defd2e6e80a5 Jul 09 10:01:51 devstack sudo[91234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:52 devstack sudo[91234]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1376dcdf-8fa7-4258-aad1-defd2e6e80a5" returned: 0 in 0.999s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] <== create_volume: return (2320ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:01:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.323s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a1af75d-cc5e-4078-8eb7-1b380c39cf94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1376dcdf-8fa7-4258-aad1-defd2e6e80a5', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947bfb73-1e9b-4f76-82a7-259095867770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:52 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Volume volume-1376dcdf-8fa7-4258-aad1-defd2e6e80a5 (1376dcdf-8fa7-4258-aad1-defd2e6e80a5): created successfully Jul 09 10:01:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (947bfb73-1e9b-4f76-82a7-259095867770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Flow 'volume_create_manager' (e93f0a4c-248f-45e8-b28e-08a4214b0677) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:01:52 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-74d7cb20-5ffe-4347-ad10-46045bdf066d tempest-VolumesActionsTest-1431754717 None] Created volume successfully. Jul 09 10:01:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-648c6bc5-6d40-4544-b36b-bc51d7d06c67 tempest-VolumesActionsTest-27274016 None] Acquiring lock "cinder-1376dcdf-8fa7-4258-aad1-defd2e6e80a5-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:01:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-648c6bc5-6d40-4544-b36b-bc51d7d06c67 tempest-VolumesActionsTest-27274016 None] Lock "cinder-1376dcdf-8fa7-4258-aad1-defd2e6e80a5-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:01:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-648c6bc5-6d40-4544-b36b-bc51d7d06c67 tempest-VolumesActionsTest-27274016 None] Acquiring lock "cinder-quobyte-1376dcdf-8fa7-4258-aad1-defd2e6e80a5" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:01:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-648c6bc5-6d40-4544-b36b-bc51d7d06c67 tempest-VolumesActionsTest-27274016 None] Lock "cinder-quobyte-1376dcdf-8fa7-4258-aad1-defd2e6e80a5" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:01:53 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ec7a52-44b1-492b-b968-6e59a844a70c]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:01:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-648c6bc5-6d40-4544-b36b-bc51d7d06c67 tempest-VolumesActionsTest-27274016 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1376dcdf-8fa7-4258-aad1-defd2e6e80a5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:53 devstack sudo[91282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1376dcdf-8fa7-4258-aad1-defd2e6e80a5 Jul 09 10:01:53 devstack sudo[91282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:54 devstack sudo[91282]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-648c6bc5-6d40-4544-b36b-bc51d7d06c67 tempest-VolumesActionsTest-27274016 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1376dcdf-8fa7-4258-aad1-defd2e6e80a5" returned: 0 in 0.923s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-648c6bc5-6d40-4544-b36b-bc51d7d06c67 tempest-VolumesActionsTest-27274016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1376dcdf-8fa7-4258-aad1-defd2e6e80a5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:54 devstack sudo[91290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1376dcdf-8fa7-4258-aad1-defd2e6e80a5 Jul 09 10:01:54 devstack sudo[91290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:54 devstack sudo[91290]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-648c6bc5-6d40-4544-b36b-bc51d7d06c67 tempest-VolumesActionsTest-27274016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1376dcdf-8fa7-4258-aad1-defd2e6e80a5" returned: 0 in 0.706s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-648c6bc5-6d40-4544-b36b-bc51d7d06c67 tempest-VolumesActionsTest-27274016 None] Lock "cinder-quobyte-1376dcdf-8fa7-4258-aad1-defd2e6e80a5" released by "delete_volume" :: held 1.684s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:01:54 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-648c6bc5-6d40-4544-b36b-bc51d7d06c67 tempest-VolumesActionsTest-27274016 None] Created reservations ['5d9cb7d3-c7f2-4ec5-bc7b-20b580adddca', '020b41c4-7e50-4e00-b3bc-8224ffce52f8', '9846aa58-75e4-4a4a-96a7-a0bf503e66cc', '6d5f8cbf-64d8-4b9b-9d7b-00be4ec42394'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:01:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-648c6bc5-6d40-4544-b36b-bc51d7d06c67 tempest-VolumesActionsTest-27274016 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-648c6bc5-6d40-4544-b36b-bc51d7d06c67 tempest-VolumesActionsTest-27274016 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-648c6bc5-6d40-4544-b36b-bc51d7d06c67 tempest-VolumesActionsTest-27274016 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:01:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-648c6bc5-6d40-4544-b36b-bc51d7d06c67 tempest-VolumesActionsTest-27274016 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:01:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-648c6bc5-6d40-4544-b36b-bc51d7d06c67 tempest-VolumesActionsTest-27274016 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-648c6bc5-6d40-4544-b36b-bc51d7d06c67 tempest-VolumesActionsTest-27274016 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:55 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:01:55 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:55 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-648c6bc5-6d40-4544-b36b-bc51d7d06c67 tempest-VolumesActionsTest-27274016 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.854s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:55 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-648c6bc5-6d40-4544-b36b-bc51d7d06c67 tempest-VolumesActionsTest-27274016 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:01:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-648c6bc5-6d40-4544-b36b-bc51d7d06c67 tempest-VolumesActionsTest-27274016 None] Deleted volume successfully. Jul 09 10:01:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-648c6bc5-6d40-4544-b36b-bc51d7d06c67 tempest-VolumesActionsTest-27274016 None] Lock "cinder-1376dcdf-8fa7-4258-aad1-defd2e6e80a5-delete_volume" released by "delete_volume" :: held 2.828s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Flow 'volume_create_manager' (2042a838-7d5e-45f6-87a4-633c271584f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5898f729-a33c-40c0-b1ae-8b0f0bc44d70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5898f729-a33c-40c0-b1ae-8b0f0bc44d70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-920100009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673fb0bb-7b62-4d44-acdf-d56c0a2120e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ac5b613c0094af887e318675618607e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:01:56Z,use_quota=True,user_id='30cf46d989dd4990a3bfc0d6779fe8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f41fbc-1c04-4518-8d6c-81279db89726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4f41fbc-1c04-4518-8d6c-81279db89726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac69d788-6ac8-46a3-9a03-ace162d6de96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac69d788-6ac8-46a3-9a03-ace162d6de96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '673fb0bb-7b62-4d44-acdf-d56c0a2120e6', 'volume_name': 'volume-673fb0bb-7b62-4d44-acdf-d56c0a2120e6', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48035d4-2103-4f05-972a-e9446bf7cafb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c48035d4-2103-4f05-972a-e9446bf7cafb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e3ad77-f8dd-484e-9496-bdac22dafb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:56 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Volume 673fb0bb-7b62-4d44-acdf-d56c0a2120e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-673fb0bb-7b62-4d44-acdf-d56c0a2120e6', 'volume_size': 1} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:01:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-920100009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=673fb0bb-7b62-4d44-acdf-d56c0a2120e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7ac5b613c0094af887e318675618607e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:01:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:01:56Z,use_quota=True,user_id='30cf46d989dd4990a3bfc0d6779fe8b3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Creating volume 673fb0bb-7b62-4d44-acdf-d56c0a2120e6 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:01:56 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:01:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-673fb0bb-7b62-4d44-acdf-d56c0a2120e6 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:56 devstack sudo[91321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-673fb0bb-7b62-4d44-acdf-d56c0a2120e6 1073741824 Jul 09 10:01:56 devstack sudo[91321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:57 devstack sudo[91321]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-673fb0bb-7b62-4d44-acdf-d56c0a2120e6 1073741824" returned: 0 in 0.865s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-673fb0bb-7b62-4d44-acdf-d56c0a2120e6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:57 devstack sudo[91326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-673fb0bb-7b62-4d44-acdf-d56c0a2120e6 Jul 09 10:01:57 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:01:57 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root Jul 09 10:01:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-673fb0bb-7b62-4d44-acdf-d56c0a2120e6" returned: 0 in 0.753s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:01:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:01:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.686s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:01:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30e3ad77-f8dd-484e-9496-bdac22dafb1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-673fb0bb-7b62-4d44-acdf-d56c0a2120e6', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1357c6f1-b504-44b2-8b6c-b0df6a40cbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:01:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Volume volume-673fb0bb-7b62-4d44-acdf-d56c0a2120e6 (673fb0bb-7b62-4d44-acdf-d56c0a2120e6): created successfully Jul 09 10:01:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1357c6f1-b504-44b2-8b6c-b0df6a40cbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:01:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Flow 'volume_create_manager' (2042a838-7d5e-45f6-87a4-633c271584f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:01:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1a95e869-2014-4402-9fad-f0c8e6fb8b90 tempest-VolumesActionsTest-1431754717 None] Created volume successfully. Jul 09 10:01:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6c312f00-9d5c-4f2f-b40d-986e32d43d51 tempest-VolumesActionsTest-1431754717 None] Acquiring lock "cinder-673fb0bb-7b62-4d44-acdf-d56c0a2120e6-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:01:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6c312f00-9d5c-4f2f-b40d-986e32d43d51 tempest-VolumesActionsTest-1431754717 None] Lock "cinder-673fb0bb-7b62-4d44-acdf-d56c0a2120e6-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:01:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6c312f00-9d5c-4f2f-b40d-986e32d43d51 tempest-VolumesActionsTest-1431754717 None] Acquiring lock "cinder-quobyte-673fb0bb-7b62-4d44-acdf-d56c0a2120e6" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:01:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6c312f00-9d5c-4f2f-b40d-986e32d43d51 tempest-VolumesActionsTest-1431754717 None] Lock "cinder-quobyte-673fb0bb-7b62-4d44-acdf-d56c0a2120e6" acquired by "delete_volume" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:01:59 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6554d8eb-2049-42aa-bf78-732a9de73d36]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:01:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c312f00-9d5c-4f2f-b40d-986e32d43d51 tempest-VolumesActionsTest-1431754717 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-673fb0bb-7b62-4d44-acdf-d56c0a2120e6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:01:59 devstack sudo[91335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-673fb0bb-7b62-4d44-acdf-d56c0a2120e6 Jul 09 10:01:59 devstack sudo[91335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:00 devstack sudo[91335]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c312f00-9d5c-4f2f-b40d-986e32d43d51 tempest-VolumesActionsTest-1431754717 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-673fb0bb-7b62-4d44-acdf-d56c0a2120e6" returned: 0 in 1.204s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c312f00-9d5c-4f2f-b40d-986e32d43d51 tempest-VolumesActionsTest-1431754717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-673fb0bb-7b62-4d44-acdf-d56c0a2120e6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:00 devstack sudo[91355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-673fb0bb-7b62-4d44-acdf-d56c0a2120e6 Jul 09 10:02:00 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:01 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c312f00-9d5c-4f2f-b40d-986e32d43d51 tempest-VolumesActionsTest-1431754717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-673fb0bb-7b62-4d44-acdf-d56c0a2120e6" returned: 0 in 0.694s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6c312f00-9d5c-4f2f-b40d-986e32d43d51 tempest-VolumesActionsTest-1431754717 None] Lock "cinder-quobyte-673fb0bb-7b62-4d44-acdf-d56c0a2120e6" released by "delete_volume" :: held 1.960s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:01 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-6c312f00-9d5c-4f2f-b40d-986e32d43d51 tempest-VolumesActionsTest-1431754717 None] Created reservations ['6de5407d-3edd-4988-867b-dd36db4897a8', '18fef714-cd14-4b4b-acfa-1730d7e272b7', '4614ab0b-fddc-42ca-bcd3-859c29ef305e', 'f0f4e166-138d-4eb3-96bc-3a788551ebca'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:02:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c312f00-9d5c-4f2f-b40d-986e32d43d51 tempest-VolumesActionsTest-1431754717 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c312f00-9d5c-4f2f-b40d-986e32d43d51 tempest-VolumesActionsTest-1431754717 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6c312f00-9d5c-4f2f-b40d-986e32d43d51 tempest-VolumesActionsTest-1431754717 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6c312f00-9d5c-4f2f-b40d-986e32d43d51 tempest-VolumesActionsTest-1431754717 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c312f00-9d5c-4f2f-b40d-986e32d43d51 tempest-VolumesActionsTest-1431754717 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c312f00-9d5c-4f2f-b40d-986e32d43d51 tempest-VolumesActionsTest-1431754717 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:01 devstack sudo[91358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:02:01 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:02 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c312f00-9d5c-4f2f-b40d-986e32d43d51 tempest-VolumesActionsTest-1431754717 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.691s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:02 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-6c312f00-9d5c-4f2f-b40d-986e32d43d51 tempest-VolumesActionsTest-1431754717 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:02:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6c312f00-9d5c-4f2f-b40d-986e32d43d51 tempest-VolumesActionsTest-1431754717 None] Deleted volume successfully. Jul 09 10:02:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6c312f00-9d5c-4f2f-b40d-986e32d43d51 tempest-VolumesActionsTest-1431754717 None] Lock "cinder-673fb0bb-7b62-4d44-acdf-d56c0a2120e6-delete_volume" released by "delete_volume" :: held 2.969s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-aeb8d1f3-f612-4610-b0a5-83a5180cf05c req-75e17a3f-6336-4de5-b1be-fff75df1ac90 tempest-AttachVolumeTestJSON-1815239661 None] Terminate volume connection completed successfully. Jul 09 10:02:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-aeb8d1f3-f612-4610-b0a5-83a5180cf05c req-75e17a3f-6336-4de5-b1be-fff75df1ac90 tempest-AttachVolumeTestJSON-1815239661 None] Deleting attachment 30b1c437-b441-41e4-b98e-d46b14194795. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:02:12 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=60,cinder:DELETE=7,cinder:SELECT=34,cinder:INSERT=11 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:02:14 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=19,cinder:UPDATE=21,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Flow 'volume_create_manager' (d47c4a64-1c04-4a2c-8afc-0916d1e3e393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b22dce-4b4d-4341-8107-c2d5ac7a4086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82b22dce-4b4d-4341-8107-c2d5ac7a4086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-52735774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08565b7c-aacc-4c28-86fc-4831641a9f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40003dd1f408441093ccd1852ec6d7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:02:17Z,use_quota=True,user_id='784bf1854f5b4d4083004996ba3d0122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1e4150-e88d-4281-ad84-94b8a9dcbbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c1e4150-e88d-4281-ad84-94b8a9dcbbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204b3116-5d32-4bc0-8cee-f9e26e01aa41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (204b3116-5d32-4bc0-8cee-f9e26e01aa41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08565b7c-aacc-4c28-86fc-4831641a9f70', 'volume_name': 'volume-08565b7c-aacc-4c28-86fc-4831641a9f70', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc195f59-b779-4914-9eb4-81deb554be71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc195f59-b779-4914-9eb4-81deb554be71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f02f54-6eda-4df2-b4c2-4bcd50e9854a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:16 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Volume 08565b7c-aacc-4c28-86fc-4831641a9f70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08565b7c-aacc-4c28-86fc-4831641a9f70', 'volume_size': 1} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-52735774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08565b7c-aacc-4c28-86fc-4831641a9f70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40003dd1f408441093ccd1852ec6d7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:02:17Z,use_quota=True,user_id='784bf1854f5b4d4083004996ba3d0122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Creating volume 08565b7c-aacc-4c28-86fc-4831641a9f70 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.066s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:02:16 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:02:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-08565b7c-aacc-4c28-86fc-4831641a9f70 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:16 devstack sudo[91505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-08565b7c-aacc-4c28-86fc-4831641a9f70 1073741824 Jul 09 10:02:16 devstack sudo[91505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:18 devstack sudo[91505]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-08565b7c-aacc-4c28-86fc-4831641a9f70 1073741824" returned: 0 in 1.866s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-08565b7c-aacc-4c28-86fc-4831641a9f70 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:18 devstack sudo[91587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-08565b7c-aacc-4c28-86fc-4831641a9f70 Jul 09 10:02:18 devstack sudo[91587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:19 devstack sudo[91587]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-08565b7c-aacc-4c28-86fc-4831641a9f70" returned: 0 in 1.175s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] <== create_volume: return (3165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:02:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.170s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9f02f54-6eda-4df2-b4c2-4bcd50e9854a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08565b7c-aacc-4c28-86fc-4831641a9f70', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2b7ed3-fca1-49e0-a382-42e74b0658c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:19 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Volume volume-08565b7c-aacc-4c28-86fc-4831641a9f70 (08565b7c-aacc-4c28-86fc-4831641a9f70): created successfully Jul 09 10:02:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d2b7ed3-fca1-49e0-a382-42e74b0658c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Flow 'volume_create_manager' (d47c4a64-1c04-4a2c-8afc-0916d1e3e393) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:02:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f342a840-c52b-4599-ad54-7620e4d39d64 tempest-VolumesListAdminTestJSON-1707625569 None] Created volume successfully. Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Flow 'volume_create_manager' (e5f3814e-c986-4d58-826b-d0e9bc4dbc62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbbc84d-a6be-4d17-bf38-c460d4bd7e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbbbc84d-a6be-4d17-bf38-c460d4bd7e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1702705657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79abd40e-edfa-4d95-9b71-785ba833ca37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40003dd1f408441093ccd1852ec6d7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:02:22Z,use_quota=True,user_id='784bf1854f5b4d4083004996ba3d0122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc68d5ff-2c7b-485e-888f-64b2a16ca08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc68d5ff-2c7b-485e-888f-64b2a16ca08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f77618a-798b-4817-835b-aa9093900d40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f77618a-798b-4817-835b-aa9093900d40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79abd40e-edfa-4d95-9b71-785ba833ca37', 'volume_name': 'volume-79abd40e-edfa-4d95-9b71-785ba833ca37', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d15c79-da8d-4d42-b773-39e5c4d919a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46d15c79-da8d-4d42-b773-39e5c4d919a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd573d2-d34f-40d5-9acd-1e61f2fc4cbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:21 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Volume 79abd40e-edfa-4d95-9b71-785ba833ca37: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79abd40e-edfa-4d95-9b71-785ba833ca37', 'volume_size': 1} Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:02:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1702705657',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79abd40e-edfa-4d95-9b71-785ba833ca37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40003dd1f408441093ccd1852ec6d7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:02:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:02:22Z,use_quota=True,user_id='784bf1854f5b4d4083004996ba3d0122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Creating volume 79abd40e-edfa-4d95-9b71-785ba833ca37 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:02:21 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:02:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-79abd40e-edfa-4d95-9b71-785ba833ca37 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:21 devstack sudo[91664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-79abd40e-edfa-4d95-9b71-785ba833ca37 1073741824 Jul 09 10:02:21 devstack sudo[91664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:22 devstack sudo[91664]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-79abd40e-edfa-4d95-9b71-785ba833ca37 1073741824" returned: 0 in 0.829s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-79abd40e-edfa-4d95-9b71-785ba833ca37 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:22 devstack sudo[91670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-79abd40e-edfa-4d95-9b71-785ba833ca37 Jul 09 10:02:22 devstack sudo[91670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:23 devstack sudo[91670]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-79abd40e-edfa-4d95-9b71-785ba833ca37" returned: 0 in 0.678s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:02:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0fd573d2-d34f-40d5-9acd-1e61f2fc4cbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79abd40e-edfa-4d95-9b71-785ba833ca37', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154ee206-3b56-4909-a522-549389ede1cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:23 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Volume volume-79abd40e-edfa-4d95-9b71-785ba833ca37 (79abd40e-edfa-4d95-9b71-785ba833ca37): created successfully Jul 09 10:02:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (154ee206-3b56-4909-a522-549389ede1cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Flow 'volume_create_manager' (e5f3814e-c986-4d58-826b-d0e9bc4dbc62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:02:23 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b89743fc-e623-47c9-84ef-0ae5b53a088c tempest-VolumesListAdminTestJSON-1707625569 None] Created volume successfully. Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Flow 'volume_create_manager' (5c30bc97-5886-4f78-8d17-7bfa7764a70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7417b9-c3d9-48a1-94ae-e281ad4dbeca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d7417b9-c3d9-48a1-94ae-e281ad4dbeca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1696988522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0185e629-8e63-4325-8141-196271da67e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40003dd1f408441093ccd1852ec6d7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:02:24Z,use_quota=True,user_id='784bf1854f5b4d4083004996ba3d0122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a379aae-20e2-4d49-a9d9-befe339e8b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a379aae-20e2-4d49-a9d9-befe339e8b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce36425-9b20-4497-8182-afb800d04fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ce36425-9b20-4497-8182-afb800d04fa0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0185e629-8e63-4325-8141-196271da67e4', 'volume_name': 'volume-0185e629-8e63-4325-8141-196271da67e4', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10227e5a-9599-4f4b-9e1a-bffd8c8a4c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10227e5a-9599-4f4b-9e1a-bffd8c8a4c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a948b28-8167-451c-8ea0-48c0e65ba703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:24 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Volume 0185e629-8e63-4325-8141-196271da67e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0185e629-8e63-4325-8141-196271da67e4', 'volume_size': 1} Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:02:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1696988522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0185e629-8e63-4325-8141-196271da67e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='40003dd1f408441093ccd1852ec6d7eb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:02:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:02:24Z,use_quota=True,user_id='784bf1854f5b4d4083004996ba3d0122',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Creating volume 0185e629-8e63-4325-8141-196271da67e4 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:02:24 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:02:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0185e629-8e63-4325-8141-196271da67e4 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:24 devstack sudo[91673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0185e629-8e63-4325-8141-196271da67e4 1073741824 Jul 09 10:02:24 devstack sudo[91673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a015574b-deef-4a69-bed7-2c9fdac41a97 tempest-AttachVolumeShelveTestJSON-567416638 None] Acquiring lock "cinder-98f1d136-43fa-454b-8b55-4fe01edb1540-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:02:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a015574b-deef-4a69-bed7-2c9fdac41a97 tempest-AttachVolumeShelveTestJSON-567416638 None] Lock "cinder-98f1d136-43fa-454b-8b55-4fe01edb1540-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:02:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a015574b-deef-4a69-bed7-2c9fdac41a97 tempest-AttachVolumeShelveTestJSON-567416638 None] Acquiring lock "cinder-quobyte-98f1d136-43fa-454b-8b55-4fe01edb1540" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:02:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a015574b-deef-4a69-bed7-2c9fdac41a97 tempest-AttachVolumeShelveTestJSON-567416638 None] Lock "cinder-quobyte-98f1d136-43fa-454b-8b55-4fe01edb1540" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:02:25 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de0f566-fd2d-4db3-9b98-7b9ea7174fa6]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:02:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a015574b-deef-4a69-bed7-2c9fdac41a97 tempest-AttachVolumeShelveTestJSON-567416638 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-98f1d136-43fa-454b-8b55-4fe01edb1540 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:25 devstack sudo[91678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-98f1d136-43fa-454b-8b55-4fe01edb1540 Jul 09 10:02:25 devstack sudo[91678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:25 devstack sudo[91673]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0185e629-8e63-4325-8141-196271da67e4 1073741824" returned: 0 in 0.965s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0185e629-8e63-4325-8141-196271da67e4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:25 devstack sudo[91681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0185e629-8e63-4325-8141-196271da67e4 Jul 09 10:02:25 devstack sudo[91681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:26 devstack sudo[91678]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a015574b-deef-4a69-bed7-2c9fdac41a97 tempest-AttachVolumeShelveTestJSON-567416638 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-98f1d136-43fa-454b-8b55-4fe01edb1540" returned: 0 in 0.791s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a015574b-deef-4a69-bed7-2c9fdac41a97 tempest-AttachVolumeShelveTestJSON-567416638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-98f1d136-43fa-454b-8b55-4fe01edb1540 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:26 devstack sudo[91686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-98f1d136-43fa-454b-8b55-4fe01edb1540 Jul 09 10:02:26 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:26 devstack sudo[91681]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0185e629-8e63-4325-8141-196271da67e4" returned: 0 in 0.696s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:02:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a948b28-8167-451c-8ea0-48c0e65ba703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0185e629-8e63-4325-8141-196271da67e4', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb17130-010e-4105-889a-c50bbe0008ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:26 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Volume volume-0185e629-8e63-4325-8141-196271da67e4 (0185e629-8e63-4325-8141-196271da67e4): created successfully Jul 09 10:02:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0bb17130-010e-4105-889a-c50bbe0008ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Flow 'volume_create_manager' (5c30bc97-5886-4f78-8d17-7bfa7764a70a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:02:26 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2de03169-bcb7-4cde-841f-38618f537e9a tempest-VolumesListAdminTestJSON-1707625569 None] Created volume successfully. Jul 09 10:02:26 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a015574b-deef-4a69-bed7-2c9fdac41a97 tempest-AttachVolumeShelveTestJSON-567416638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-98f1d136-43fa-454b-8b55-4fe01edb1540" returned: 0 in 0.679s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a015574b-deef-4a69-bed7-2c9fdac41a97 tempest-AttachVolumeShelveTestJSON-567416638 None] Lock "cinder-quobyte-98f1d136-43fa-454b-8b55-4fe01edb1540" released by "delete_volume" :: held 1.539s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:26 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a015574b-deef-4a69-bed7-2c9fdac41a97 tempest-AttachVolumeShelveTestJSON-567416638 None] Created reservations ['61cc819a-5385-4181-a34d-d01605895500', '289a7a84-cb13-4617-93f0-398127e93a63', 'da233ccf-400d-40c2-9751-d9f47b81b76b', 'ca290ed7-6447-457f-97eb-fecbd7ff4a2b'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:02:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a015574b-deef-4a69-bed7-2c9fdac41a97 tempest-AttachVolumeShelveTestJSON-567416638 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a015574b-deef-4a69-bed7-2c9fdac41a97 tempest-AttachVolumeShelveTestJSON-567416638 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a015574b-deef-4a69-bed7-2c9fdac41a97 tempest-AttachVolumeShelveTestJSON-567416638 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a015574b-deef-4a69-bed7-2c9fdac41a97 tempest-AttachVolumeShelveTestJSON-567416638 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a015574b-deef-4a69-bed7-2c9fdac41a97 tempest-AttachVolumeShelveTestJSON-567416638 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a015574b-deef-4a69-bed7-2c9fdac41a97 tempest-AttachVolumeShelveTestJSON-567416638 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:26 devstack sudo[91690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:02:27 devstack sudo[91690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Flow 'volume_create_manager' (fa3db9ed-8f96-448a-aba8-35862dcfe108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3a78c5-648c-4c0e-9c6a-0f28b76e1ebd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3d3a78c5-648c-4c0e-9c6a-0f28b76e1ebd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34eedce0-2067-47bf-b5b8-1d26c61051c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bad97cbac47c46beac1d2963f9ad4123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:02:27Z,use_quota=True,user_id='b390d61ef71f423fb6e0cc351f8c21da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11dca465-58bd-4c9e-99f4-cb597e3bccba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11dca465-58bd-4c9e-99f4-cb597e3bccba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146b927e-fb72-4bf2-ba57-0997162e8cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (146b927e-fb72-4bf2-ba57-0997162e8cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34eedce0-2067-47bf-b5b8-1d26c61051c2', 'volume_name': 'volume-34eedce0-2067-47bf-b5b8-1d26c61051c2', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4a1e15-5525-45f8-ac62-3f424cf44f6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d4a1e15-5525-45f8-ac62-3f424cf44f6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b334741f-9878-4f92-952e-2a3016b165fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:27 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Volume 34eedce0-2067-47bf-b5b8-1d26c61051c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34eedce0-2067-47bf-b5b8-1d26c61051c2', 'volume_size': 1} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:02:27Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34eedce0-2067-47bf-b5b8-1d26c61051c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bad97cbac47c46beac1d2963f9ad4123',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:02:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:02:27Z,use_quota=True,user_id='b390d61ef71f423fb6e0cc351f8c21da',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Creating volume 34eedce0-2067-47bf-b5b8-1d26c61051c2 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:02:27 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-34eedce0-2067-47bf-b5b8-1d26c61051c2 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:27 devstack sudo[91692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-34eedce0-2067-47bf-b5b8-1d26c61051c2 1073741824 Jul 09 10:02:27 devstack sudo[91692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:27 devstack sudo[91690]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a015574b-deef-4a69-bed7-2c9fdac41a97 tempest-AttachVolumeShelveTestJSON-567416638 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.874s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a015574b-deef-4a69-bed7-2c9fdac41a97 tempest-AttachVolumeShelveTestJSON-567416638 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:02:27 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a015574b-deef-4a69-bed7-2c9fdac41a97 tempest-AttachVolumeShelveTestJSON-567416638 None] Deleted volume successfully. Jul 09 10:02:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a015574b-deef-4a69-bed7-2c9fdac41a97 tempest-AttachVolumeShelveTestJSON-567416638 None] Lock "cinder-98f1d136-43fa-454b-8b55-4fe01edb1540-delete_volume" released by "delete_volume" :: held 2.683s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:28 devstack sudo[91692]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-34eedce0-2067-47bf-b5b8-1d26c61051c2 1073741824" returned: 0 in 1.174s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-34eedce0-2067-47bf-b5b8-1d26c61051c2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:28 devstack sudo[91701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-34eedce0-2067-47bf-b5b8-1d26c61051c2 Jul 09 10:02:28 devstack sudo[91701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:29 devstack sudo[91701]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-34eedce0-2067-47bf-b5b8-1d26c61051c2" returned: 0 in 0.945s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] <== create_volume: return (2185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:02:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.187s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b334741f-9878-4f92-952e-2a3016b165fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34eedce0-2067-47bf-b5b8-1d26c61051c2', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6907c49-4a72-4164-aa7d-51874a2ca645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:29 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Volume volume-34eedce0-2067-47bf-b5b8-1d26c61051c2 (34eedce0-2067-47bf-b5b8-1d26c61051c2): created successfully Jul 09 10:02:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d6907c49-4a72-4164-aa7d-51874a2ca645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Flow 'volume_create_manager' (fa3db9ed-8f96-448a-aba8-35862dcfe108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:02:29 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8f6ed3e3-9e4f-4d81-8fb2-7d28471af135 tempest-VolumesListAdminTestJSON-482446699 None] Created volume successfully. Jul 09 10:02:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:02:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:29 devstack sudo[91720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:02:29 devstack sudo[91720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:30 devstack sudo[91720]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.713s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:02:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:02:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 8 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:02:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:02:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-63041182-85cc-4b05-bed8-c5726e62019f tempest-VolumesListAdminTestJSON-482446699 None] Acquiring lock "cinder-34eedce0-2067-47bf-b5b8-1d26c61051c2-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:02:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-63041182-85cc-4b05-bed8-c5726e62019f tempest-VolumesListAdminTestJSON-482446699 None] Lock "cinder-34eedce0-2067-47bf-b5b8-1d26c61051c2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:02:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-63041182-85cc-4b05-bed8-c5726e62019f tempest-VolumesListAdminTestJSON-482446699 None] Acquiring lock "cinder-quobyte-34eedce0-2067-47bf-b5b8-1d26c61051c2" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:02:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-63041182-85cc-4b05-bed8-c5726e62019f tempest-VolumesListAdminTestJSON-482446699 None] Lock "cinder-quobyte-34eedce0-2067-47bf-b5b8-1d26c61051c2" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:02:31 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb9e9d7f-1b28-475d-a9a5-94e5da431d14]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:02:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-63041182-85cc-4b05-bed8-c5726e62019f tempest-VolumesListAdminTestJSON-482446699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-34eedce0-2067-47bf-b5b8-1d26c61051c2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bca407ca-6fce-4596-8f2b-55af3b8f960c tempest-VolumesListAdminTestJSON-1707625569 None] Acquiring lock "cinder-0185e629-8e63-4325-8141-196271da67e4-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:02:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bca407ca-6fce-4596-8f2b-55af3b8f960c tempest-VolumesListAdminTestJSON-1707625569 None] Lock "cinder-0185e629-8e63-4325-8141-196271da67e4-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:02:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bca407ca-6fce-4596-8f2b-55af3b8f960c tempest-VolumesListAdminTestJSON-1707625569 None] Acquiring lock "cinder-quobyte-0185e629-8e63-4325-8141-196271da67e4" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:02:31 devstack sudo[91727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-34eedce0-2067-47bf-b5b8-1d26c61051c2 Jul 09 10:02:31 devstack sudo[91727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bca407ca-6fce-4596-8f2b-55af3b8f960c tempest-VolumesListAdminTestJSON-1707625569 None] Lock "cinder-quobyte-0185e629-8e63-4325-8141-196271da67e4" acquired by "delete_volume" :: waited 0.037s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:02:31 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9882b6fe-43e8-4fa6-809d-dc89ee6f1a13]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:02:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bca407ca-6fce-4596-8f2b-55af3b8f960c tempest-VolumesListAdminTestJSON-1707625569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0185e629-8e63-4325-8141-196271da67e4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:31 devstack sudo[91729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0185e629-8e63-4325-8141-196271da67e4 Jul 09 10:02:31 devstack sudo[91729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:32 devstack sudo[91727]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-63041182-85cc-4b05-bed8-c5726e62019f tempest-VolumesListAdminTestJSON-482446699 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-34eedce0-2067-47bf-b5b8-1d26c61051c2" returned: 0 in 1.387s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-63041182-85cc-4b05-bed8-c5726e62019f tempest-VolumesListAdminTestJSON-482446699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-34eedce0-2067-47bf-b5b8-1d26c61051c2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:32 devstack sudo[91747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-34eedce0-2067-47bf-b5b8-1d26c61051c2 Jul 09 10:02:32 devstack sudo[91747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:32 devstack sudo[91729]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bca407ca-6fce-4596-8f2b-55af3b8f960c tempest-VolumesListAdminTestJSON-1707625569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0185e629-8e63-4325-8141-196271da67e4" returned: 0 in 1.184s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bca407ca-6fce-4596-8f2b-55af3b8f960c tempest-VolumesListAdminTestJSON-1707625569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0185e629-8e63-4325-8141-196271da67e4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:32 devstack sudo[91749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0185e629-8e63-4325-8141-196271da67e4 Jul 09 10:02:32 devstack sudo[91749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:33 devstack sudo[91747]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-63041182-85cc-4b05-bed8-c5726e62019f tempest-VolumesListAdminTestJSON-482446699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-34eedce0-2067-47bf-b5b8-1d26c61051c2" returned: 0 in 0.902s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-63041182-85cc-4b05-bed8-c5726e62019f tempest-VolumesListAdminTestJSON-482446699 None] Lock "cinder-quobyte-34eedce0-2067-47bf-b5b8-1d26c61051c2" released by "delete_volume" :: held 2.372s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:33 devstack sudo[91749]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bca407ca-6fce-4596-8f2b-55af3b8f960c tempest-VolumesListAdminTestJSON-1707625569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0185e629-8e63-4325-8141-196271da67e4" returned: 0 in 0.849s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bca407ca-6fce-4596-8f2b-55af3b8f960c tempest-VolumesListAdminTestJSON-1707625569 None] Lock "cinder-quobyte-0185e629-8e63-4325-8141-196271da67e4" released by "delete_volume" :: held 2.111s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:33 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-63041182-85cc-4b05-bed8-c5726e62019f tempest-VolumesListAdminTestJSON-482446699 None] Created reservations ['4ba62ad3-cc85-4b59-a081-90baef7a5160', '46b0cde7-9269-4f8a-9eae-62053bf21d89', 'f717db26-ceff-4c01-818c-ce66414f34c5', '5ba4d122-b96c-4398-aece-f5354df9a05d'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:02:33 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-bca407ca-6fce-4596-8f2b-55af3b8f960c tempest-VolumesListAdminTestJSON-1707625569 None] Created reservations ['82c52df5-a089-4b6a-907e-e6b006f3a198', '99ac98cc-c3fa-482f-9cc5-fbf7835df076', 'e6fb5736-6948-4904-ba0f-708e6e8176a8', '81405585-b8bb-46d6-9c7a-53b74abef5e4'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:02:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-63041182-85cc-4b05-bed8-c5726e62019f tempest-VolumesListAdminTestJSON-482446699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-63041182-85cc-4b05-bed8-c5726e62019f tempest-VolumesListAdminTestJSON-482446699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-63041182-85cc-4b05-bed8-c5726e62019f tempest-VolumesListAdminTestJSON-482446699 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-63041182-85cc-4b05-bed8-c5726e62019f tempest-VolumesListAdminTestJSON-482446699 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-63041182-85cc-4b05-bed8-c5726e62019f tempest-VolumesListAdminTestJSON-482446699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-63041182-85cc-4b05-bed8-c5726e62019f tempest-VolumesListAdminTestJSON-482446699 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:33 devstack sudo[91754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:02:33 devstack sudo[91754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bca407ca-6fce-4596-8f2b-55af3b8f960c tempest-VolumesListAdminTestJSON-1707625569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bca407ca-6fce-4596-8f2b-55af3b8f960c tempest-VolumesListAdminTestJSON-1707625569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bca407ca-6fce-4596-8f2b-55af3b8f960c tempest-VolumesListAdminTestJSON-1707625569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bca407ca-6fce-4596-8f2b-55af3b8f960c tempest-VolumesListAdminTestJSON-1707625569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bca407ca-6fce-4596-8f2b-55af3b8f960c tempest-VolumesListAdminTestJSON-1707625569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bca407ca-6fce-4596-8f2b-55af3b8f960c tempest-VolumesListAdminTestJSON-1707625569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:33 devstack sudo[91756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:02:33 devstack sudo[91756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:34 devstack sudo[91754]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-63041182-85cc-4b05-bed8-c5726e62019f tempest-VolumesListAdminTestJSON-482446699 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.788s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:34 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-63041182-85cc-4b05-bed8-c5726e62019f tempest-VolumesListAdminTestJSON-482446699 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:02:34 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-63041182-85cc-4b05-bed8-c5726e62019f tempest-VolumesListAdminTestJSON-482446699 None] Deleted volume successfully. Jul 09 10:02:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-63041182-85cc-4b05-bed8-c5726e62019f tempest-VolumesListAdminTestJSON-482446699 None] Lock "cinder-34eedce0-2067-47bf-b5b8-1d26c61051c2-delete_volume" released by "delete_volume" :: held 3.488s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:34 devstack sudo[91756]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bca407ca-6fce-4596-8f2b-55af3b8f960c tempest-VolumesListAdminTestJSON-1707625569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.813s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:34 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-bca407ca-6fce-4596-8f2b-55af3b8f960c tempest-VolumesListAdminTestJSON-1707625569 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:02:34 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-bca407ca-6fce-4596-8f2b-55af3b8f960c tempest-VolumesListAdminTestJSON-1707625569 None] Deleted volume successfully. Jul 09 10:02:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bca407ca-6fce-4596-8f2b-55af3b8f960c tempest-VolumesListAdminTestJSON-1707625569 None] Lock "cinder-0185e629-8e63-4325-8141-196271da67e4-delete_volume" released by "delete_volume" :: held 3.315s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2cf94e5f-e2ea-40f7-9b83-bc4bf6bcdfeb tempest-VolumesListAdminTestJSON-1707625569 None] Acquiring lock "cinder-79abd40e-edfa-4d95-9b71-785ba833ca37-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:02:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2cf94e5f-e2ea-40f7-9b83-bc4bf6bcdfeb tempest-VolumesListAdminTestJSON-1707625569 None] Lock "cinder-79abd40e-edfa-4d95-9b71-785ba833ca37-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:02:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2cf94e5f-e2ea-40f7-9b83-bc4bf6bcdfeb tempest-VolumesListAdminTestJSON-1707625569 None] Acquiring lock "cinder-quobyte-79abd40e-edfa-4d95-9b71-785ba833ca37" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:02:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2cf94e5f-e2ea-40f7-9b83-bc4bf6bcdfeb tempest-VolumesListAdminTestJSON-1707625569 None] Lock "cinder-quobyte-79abd40e-edfa-4d95-9b71-785ba833ca37" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:02:34 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8eba169-463e-4691-a96a-0161f524b151]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:02:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2cf94e5f-e2ea-40f7-9b83-bc4bf6bcdfeb tempest-VolumesListAdminTestJSON-1707625569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-79abd40e-edfa-4d95-9b71-785ba833ca37 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:34 devstack sudo[91760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-79abd40e-edfa-4d95-9b71-785ba833ca37 Jul 09 10:02:34 devstack sudo[91760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:35 devstack sudo[91760]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2cf94e5f-e2ea-40f7-9b83-bc4bf6bcdfeb tempest-VolumesListAdminTestJSON-1707625569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-79abd40e-edfa-4d95-9b71-785ba833ca37" returned: 0 in 0.839s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2cf94e5f-e2ea-40f7-9b83-bc4bf6bcdfeb tempest-VolumesListAdminTestJSON-1707625569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-79abd40e-edfa-4d95-9b71-785ba833ca37 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:35 devstack sudo[91767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-79abd40e-edfa-4d95-9b71-785ba833ca37 Jul 09 10:02:35 devstack sudo[91767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:36 devstack sudo[91767]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2cf94e5f-e2ea-40f7-9b83-bc4bf6bcdfeb tempest-VolumesListAdminTestJSON-1707625569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-79abd40e-edfa-4d95-9b71-785ba833ca37" returned: 0 in 0.683s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2cf94e5f-e2ea-40f7-9b83-bc4bf6bcdfeb tempest-VolumesListAdminTestJSON-1707625569 None] Lock "cinder-quobyte-79abd40e-edfa-4d95-9b71-785ba833ca37" released by "delete_volume" :: held 1.569s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-2cf94e5f-e2ea-40f7-9b83-bc4bf6bcdfeb tempest-VolumesListAdminTestJSON-1707625569 None] Created reservations ['33d2bb02-6f98-4913-9ec2-df7741e89719', 'f6ae7d70-70cf-40f5-9a53-ed43926904f1', '231167e8-95a9-4f47-97c0-455a1192e014', '850df051-dc15-457a-8b85-f5b08a2bb2be'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2cf94e5f-e2ea-40f7-9b83-bc4bf6bcdfeb tempest-VolumesListAdminTestJSON-1707625569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2cf94e5f-e2ea-40f7-9b83-bc4bf6bcdfeb tempest-VolumesListAdminTestJSON-1707625569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2cf94e5f-e2ea-40f7-9b83-bc4bf6bcdfeb tempest-VolumesListAdminTestJSON-1707625569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2cf94e5f-e2ea-40f7-9b83-bc4bf6bcdfeb tempest-VolumesListAdminTestJSON-1707625569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2cf94e5f-e2ea-40f7-9b83-bc4bf6bcdfeb tempest-VolumesListAdminTestJSON-1707625569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2cf94e5f-e2ea-40f7-9b83-bc4bf6bcdfeb tempest-VolumesListAdminTestJSON-1707625569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:36 devstack sudo[91770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:02:36 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Flow 'volume_create_manager' (5e660110-3f88-449b-9bb6-4c24281d65b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f261464-bf33-4ff7-a32f-5861c5841cb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f261464-bf33-4ff7-a32f-5861c5841cb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-876396424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d8cb80-2bb9-4027-96c0-57d5a6e35400,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='674f149bff064a51bed64b6a7d0877d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:02:37Z,use_quota=True,user_id='29d1119426cf4cdea903031f2d861950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b863eb-8869-47bf-965b-8c267914ee23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26b863eb-8869-47bf-965b-8c267914ee23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794972c7-0648-4c48-a547-2b197dbd11a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (794972c7-0648-4c48-a547-2b197dbd11a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27d8cb80-2bb9-4027-96c0-57d5a6e35400', 'volume_name': 'volume-27d8cb80-2bb9-4027-96c0-57d5a6e35400', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0231c72d-b3fe-491c-a35f-c1e7968c81cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0231c72d-b3fe-491c-a35f-c1e7968c81cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ebbd8ea-deef-415a-81e4-11bc8dd336ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:36 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Volume 27d8cb80-2bb9-4027-96c0-57d5a6e35400: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27d8cb80-2bb9-4027-96c0-57d5a6e35400', 'volume_size': 1} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:02:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-876396424',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27d8cb80-2bb9-4027-96c0-57d5a6e35400,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='674f149bff064a51bed64b6a7d0877d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:02:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:02:37Z,use_quota=True,user_id='29d1119426cf4cdea903031f2d861950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Creating volume 27d8cb80-2bb9-4027-96c0-57d5a6e35400 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:02:36 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27d8cb80-2bb9-4027-96c0-57d5a6e35400 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:36 devstack sudo[91772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27d8cb80-2bb9-4027-96c0-57d5a6e35400 1073741824 Jul 09 10:02:36 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4688635a-c2d0-4eeb-9ed0-2bab49d81a5a tempest-VolumesListAdminTestJSON-1707625569 None] Acquiring lock "cinder-08565b7c-aacc-4c28-86fc-4831641a9f70-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4688635a-c2d0-4eeb-9ed0-2bab49d81a5a tempest-VolumesListAdminTestJSON-1707625569 None] Lock "cinder-08565b7c-aacc-4c28-86fc-4831641a9f70-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:02:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4688635a-c2d0-4eeb-9ed0-2bab49d81a5a tempest-VolumesListAdminTestJSON-1707625569 None] Acquiring lock "cinder-quobyte-08565b7c-aacc-4c28-86fc-4831641a9f70" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:02:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4688635a-c2d0-4eeb-9ed0-2bab49d81a5a tempest-VolumesListAdminTestJSON-1707625569 None] Lock "cinder-quobyte-08565b7c-aacc-4c28-86fc-4831641a9f70" acquired by "delete_volume" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:02:37 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[31477e29-682d-4b73-9279-d24c4a4414b3]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:02:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4688635a-c2d0-4eeb-9ed0-2bab49d81a5a tempest-VolumesListAdminTestJSON-1707625569 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-08565b7c-aacc-4c28-86fc-4831641a9f70 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:37 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2cf94e5f-e2ea-40f7-9b83-bc4bf6bcdfeb tempest-VolumesListAdminTestJSON-1707625569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.705s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-2cf94e5f-e2ea-40f7-9b83-bc4bf6bcdfeb tempest-VolumesListAdminTestJSON-1707625569 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:02:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2cf94e5f-e2ea-40f7-9b83-bc4bf6bcdfeb tempest-VolumesListAdminTestJSON-1707625569 None] Deleted volume successfully. Jul 09 10:02:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2cf94e5f-e2ea-40f7-9b83-bc4bf6bcdfeb tempest-VolumesListAdminTestJSON-1707625569 None] Lock "cinder-79abd40e-edfa-4d95-9b71-785ba833ca37-delete_volume" released by "delete_volume" :: held 2.505s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:37 devstack sudo[91775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-08565b7c-aacc-4c28-86fc-4831641a9f70 Jul 09 10:02:37 devstack sudo[91775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:37 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27d8cb80-2bb9-4027-96c0-57d5a6e35400 1073741824" returned: 0 in 0.938s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27d8cb80-2bb9-4027-96c0-57d5a6e35400 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:37 devstack sudo[91784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27d8cb80-2bb9-4027-96c0-57d5a6e35400 Jul 09 10:02:37 devstack sudo[91784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:37 devstack sudo[91775]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4688635a-c2d0-4eeb-9ed0-2bab49d81a5a tempest-VolumesListAdminTestJSON-1707625569 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-08565b7c-aacc-4c28-86fc-4831641a9f70" returned: 0 in 0.800s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4688635a-c2d0-4eeb-9ed0-2bab49d81a5a tempest-VolumesListAdminTestJSON-1707625569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-08565b7c-aacc-4c28-86fc-4831641a9f70 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:37 devstack sudo[91787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-08565b7c-aacc-4c28-86fc-4831641a9f70 Jul 09 10:02:37 devstack sudo[91787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:38 devstack sudo[91784]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27d8cb80-2bb9-4027-96c0-57d5a6e35400" returned: 0 in 0.866s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] <== create_volume: return (1846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:02:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.848s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ebbd8ea-deef-415a-81e4-11bc8dd336ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27d8cb80-2bb9-4027-96c0-57d5a6e35400', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12528174-b752-49e4-81a2-dd055ba396d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:38 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Volume volume-27d8cb80-2bb9-4027-96c0-57d5a6e35400 (27d8cb80-2bb9-4027-96c0-57d5a6e35400): created successfully Jul 09 10:02:38 devstack sudo[91787]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12528174-b752-49e4-81a2-dd055ba396d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Flow 'volume_create_manager' (5e660110-3f88-449b-9bb6-4c24281d65b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:02:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4688635a-c2d0-4eeb-9ed0-2bab49d81a5a tempest-VolumesListAdminTestJSON-1707625569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-08565b7c-aacc-4c28-86fc-4831641a9f70" returned: 0 in 0.816s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4688635a-c2d0-4eeb-9ed0-2bab49d81a5a tempest-VolumesListAdminTestJSON-1707625569 None] Lock "cinder-quobyte-08565b7c-aacc-4c28-86fc-4831641a9f70" released by "delete_volume" :: held 1.683s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:38 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6d17bd59-0d4a-4b7a-ab13-cc9f6c3df565 tempest-VolumesTestJSON-2016295332 None] Created volume successfully. Jul 09 10:02:38 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-4688635a-c2d0-4eeb-9ed0-2bab49d81a5a tempest-VolumesListAdminTestJSON-1707625569 None] Created reservations ['24946487-c128-446e-9709-ad28e4443c5e', '1fbc7bb6-ba06-4420-9bdc-9f60a35042d8', '08e64cd3-d285-4fdc-aae4-e42425b7aa85', '40fa9a53-78dc-4d75-86a2-678d7d52f467'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:02:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4688635a-c2d0-4eeb-9ed0-2bab49d81a5a tempest-VolumesListAdminTestJSON-1707625569 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4688635a-c2d0-4eeb-9ed0-2bab49d81a5a tempest-VolumesListAdminTestJSON-1707625569 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4688635a-c2d0-4eeb-9ed0-2bab49d81a5a tempest-VolumesListAdminTestJSON-1707625569 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4688635a-c2d0-4eeb-9ed0-2bab49d81a5a tempest-VolumesListAdminTestJSON-1707625569 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4688635a-c2d0-4eeb-9ed0-2bab49d81a5a tempest-VolumesListAdminTestJSON-1707625569 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4688635a-c2d0-4eeb-9ed0-2bab49d81a5a tempest-VolumesListAdminTestJSON-1707625569 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:38 devstack sudo[91829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:02:38 devstack sudo[91829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:39 devstack sudo[91829]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4688635a-c2d0-4eeb-9ed0-2bab49d81a5a tempest-VolumesListAdminTestJSON-1707625569 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.801s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:39 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-4688635a-c2d0-4eeb-9ed0-2bab49d81a5a tempest-VolumesListAdminTestJSON-1707625569 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:02:39 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4688635a-c2d0-4eeb-9ed0-2bab49d81a5a tempest-VolumesListAdminTestJSON-1707625569 None] Deleted volume successfully. Jul 09 10:02:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4688635a-c2d0-4eeb-9ed0-2bab49d81a5a tempest-VolumesListAdminTestJSON-1707625569 None] Lock "cinder-08565b7c-aacc-4c28-86fc-4831641a9f70-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Flow 'volume_create_manager' (663015c7-77d0-48ef-9565-18eb81b1deb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d74a9f4-3a2b-4489-aaab-304f82df9e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d74a9f4-3a2b-4489-aaab-304f82df9e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2080656337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad526a9a-c636-4d5c-8d92-2701e371b391,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='674f149bff064a51bed64b6a7d0877d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:02:41Z,use_quota=True,user_id='29d1119426cf4cdea903031f2d861950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab673614-ebed-4c9f-ab85-71b44fed5303) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab673614-ebed-4c9f-ab85-71b44fed5303) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d524d4bf-c4d8-46ab-b4be-7f204e05a443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d524d4bf-c4d8-46ab-b4be-7f204e05a443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad526a9a-c636-4d5c-8d92-2701e371b391', 'volume_name': 'volume-ad526a9a-c636-4d5c-8d92-2701e371b391', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8abe03-1614-465d-884b-4e92f9643e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7a8abe03-1614-465d-884b-4e92f9643e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d924d17d-a203-4541-b871-4c7f08441138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:40 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Volume ad526a9a-c636-4d5c-8d92-2701e371b391: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad526a9a-c636-4d5c-8d92-2701e371b391', 'volume_size': 1} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:02:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-2080656337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad526a9a-c636-4d5c-8d92-2701e371b391,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='674f149bff064a51bed64b6a7d0877d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:02:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:02:41Z,use_quota=True,user_id='29d1119426cf4cdea903031f2d861950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Creating volume ad526a9a-c636-4d5c-8d92-2701e371b391 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:02:40 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:02:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad526a9a-c636-4d5c-8d92-2701e371b391 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:40 devstack sudo[91847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad526a9a-c636-4d5c-8d92-2701e371b391 1073741824 Jul 09 10:02:40 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:41 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad526a9a-c636-4d5c-8d92-2701e371b391 1073741824" returned: 0 in 1.028s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad526a9a-c636-4d5c-8d92-2701e371b391 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:41 devstack sudo[91860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad526a9a-c636-4d5c-8d92-2701e371b391 Jul 09 10:02:41 devstack sudo[91860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:42 devstack sudo[91860]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad526a9a-c636-4d5c-8d92-2701e371b391" returned: 0 in 0.746s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:02:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.840s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d924d17d-a203-4541-b871-4c7f08441138) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad526a9a-c636-4d5c-8d92-2701e371b391', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b964562f-279f-4e69-9342-b607c04c705a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:42 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Volume volume-ad526a9a-c636-4d5c-8d92-2701e371b391 (ad526a9a-c636-4d5c-8d92-2701e371b391): created successfully Jul 09 10:02:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b964562f-279f-4e69-9342-b607c04c705a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Flow 'volume_create_manager' (663015c7-77d0-48ef-9565-18eb81b1deb1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:02:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-abdd138d-87eb-4c71-a835-21b83da75998 tempest-VolumesTestJSON-2016295332 None] Created volume successfully. Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Flow 'volume_create_manager' (06bb47b6-5b3c-470e-8e53-a9bedc8248a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d590302-3aa4-45ca-8fb7-939fc71f232f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d590302-3aa4-45ca-8fb7-939fc71f232f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1296373640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed90f4c2-03d9-432a-b742-ef6527486b7b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='674f149bff064a51bed64b6a7d0877d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:02:44Z,use_quota=True,user_id='29d1119426cf4cdea903031f2d861950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fe6f24-57a9-4b55-8e4e-f70ce37d01e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70fe6f24-57a9-4b55-8e4e-f70ce37d01e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6191d76a-7f78-49cb-9795-b03af28038d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6191d76a-7f78-49cb-9795-b03af28038d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed90f4c2-03d9-432a-b742-ef6527486b7b', 'volume_name': 'volume-ed90f4c2-03d9-432a-b742-ef6527486b7b', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d02016-420e-4141-b24e-e8bd4a41aa63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18d02016-420e-4141-b24e-e8bd4a41aa63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e900543a-eae2-4d41-b257-83f5ac5785c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:44 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Volume ed90f4c2-03d9-432a-b742-ef6527486b7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed90f4c2-03d9-432a-b742-ef6527486b7b', 'volume_size': 1} Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1296373640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed90f4c2-03d9-432a-b742-ef6527486b7b,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='674f149bff064a51bed64b6a7d0877d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:02:44Z,use_quota=True,user_id='29d1119426cf4cdea903031f2d861950',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Creating volume ed90f4c2-03d9-432a-b742-ef6527486b7b {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:02:44 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:02:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ed90f4c2-03d9-432a-b742-ef6527486b7b 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:44 devstack sudo[91893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ed90f4c2-03d9-432a-b742-ef6527486b7b 1073741824 Jul 09 10:02:44 devstack sudo[91893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:45 devstack sudo[91893]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ed90f4c2-03d9-432a-b742-ef6527486b7b 1073741824" returned: 0 in 1.007s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-1d0abe51-7021-4d6e-b578-91e295275876 req-7e202b55-b9be-4a4d-9278-84af2c2c978d tempest-TaggedAttachmentsTest-420306876 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ed90f4c2-03d9-432a-b742-ef6527486b7b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:45 devstack sudo[91909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ed90f4c2-03d9-432a-b742-ef6527486b7b Jul 09 10:02:45 devstack sudo[91909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:46 devstack sudo[91909]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ed90f4c2-03d9-432a-b742-ef6527486b7b" returned: 0 in 0.676s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:02:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-1d0abe51-7021-4d6e-b578-91e295275876 req-7e202b55-b9be-4a4d-9278-84af2c2c978d tempest-TaggedAttachmentsTest-420306876 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.709s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e900543a-eae2-4d41-b257-83f5ac5785c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed90f4c2-03d9-432a-b742-ef6527486b7b', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32353af6-e525-4621-981c-c60e38a725ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:46 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d85d3996-6652-497e-9891-40f5e50481b7]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:02:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-1d0abe51-7021-4d6e-b578-91e295275876 req-7e202b55-b9be-4a4d-9278-84af2c2c978d tempest-TaggedAttachmentsTest-420306876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b181a6b8-efc1-4603-9e71-25c44ec43953 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:46 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Volume volume-ed90f4c2-03d9-432a-b742-ef6527486b7b (ed90f4c2-03d9-432a-b742-ef6527486b7b): created successfully Jul 09 10:02:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32353af6-e525-4621-981c-c60e38a725ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Flow 'volume_create_manager' (06bb47b6-5b3c-470e-8e53-a9bedc8248a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:02:46 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0cd94a07-1825-4fd9-a2d8-6172fa276c5d tempest-VolumesTestJSON-2016295332 None] Created volume successfully. Jul 09 10:02:46 devstack sudo[91912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b181a6b8-efc1-4603-9e71-25c44ec43953 Jul 09 10:02:46 devstack sudo[91912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:47 devstack sudo[91912]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-1d0abe51-7021-4d6e-b578-91e295275876 req-7e202b55-b9be-4a4d-9278-84af2c2c978d tempest-TaggedAttachmentsTest-420306876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b181a6b8-efc1-4603-9e71-25c44ec43953" returned: 0 in 0.882s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-1d0abe51-7021-4d6e-b578-91e295275876 req-7e202b55-b9be-4a4d-9278-84af2c2c978d tempest-TaggedAttachmentsTest-420306876 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.911s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-1d0abe51-7021-4d6e-b578-91e295275876 req-7e202b55-b9be-4a4d-9278-84af2c2c978d tempest-TaggedAttachmentsTest-420306876 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-b181a6b8-efc1-4603-9e71-25c44ec43953', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '01a7e69a-4801-453b-aa62-0f1779e6784d', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:02:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-1d0abe51-7021-4d6e-b578-91e295275876 req-7e202b55-b9be-4a4d-9278-84af2c2c978d tempest-TaggedAttachmentsTest-420306876 None] attachment_update completed successfully. Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Flow 'volume_create_manager' (4a4cb254-0ad6-4ac4-b453-99442b29283f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f37837-ba4b-4feb-9a39-63bae6aaf24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6811c654-d6bc-466b-8caa-f59bcfc67471 tempest-VolumesTestJSON-2016295332 None] Acquiring lock "cinder-ed90f4c2-03d9-432a-b742-ef6527486b7b-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45f37837-ba4b-4feb-9a39-63bae6aaf24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1682045225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa4114f-1a18-48af-bf26-a893abf19450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585e371f00ea4f6fb9f13ceab7094896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:02:48Z,use_quota=True,user_id='af62de1fc6e44400a54b848910c42599',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2fd52d-23fd-4b4c-be3b-9c304d7fd993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b2fd52d-23fd-4b4c-be3b-9c304d7fd993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5731a4d8-1774-4d7b-913d-6b393f27411b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5731a4d8-1774-4d7b-913d-6b393f27411b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caa4114f-1a18-48af-bf26-a893abf19450', 'volume_name': 'volume-caa4114f-1a18-48af-bf26-a893abf19450', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b3780e-2c02-4628-86a5-b8540ecd9338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00b3780e-2c02-4628-86a5-b8540ecd9338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e21d0cc-4287-4798-a5f1-778d950d0807) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:48 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Volume caa4114f-1a18-48af-bf26-a893abf19450: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caa4114f-1a18-48af-bf26-a893abf19450', 'volume_size': 1} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:02:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1682045225',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caa4114f-1a18-48af-bf26-a893abf19450,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585e371f00ea4f6fb9f13ceab7094896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:02:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:02:48Z,use_quota=True,user_id='af62de1fc6e44400a54b848910c42599',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Creating volume caa4114f-1a18-48af-bf26-a893abf19450 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:02:48 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-caa4114f-1a18-48af-bf26-a893abf19450 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6811c654-d6bc-466b-8caa-f59bcfc67471 tempest-VolumesTestJSON-2016295332 None] Lock "cinder-ed90f4c2-03d9-432a-b742-ef6527486b7b-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:02:48 devstack sudo[91985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-caa4114f-1a18-48af-bf26-a893abf19450 1073741824 Jul 09 10:02:48 devstack sudo[91985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6811c654-d6bc-466b-8caa-f59bcfc67471 tempest-VolumesTestJSON-2016295332 None] Acquiring lock "cinder-quobyte-ed90f4c2-03d9-432a-b742-ef6527486b7b" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6811c654-d6bc-466b-8caa-f59bcfc67471 tempest-VolumesTestJSON-2016295332 None] Lock "cinder-quobyte-ed90f4c2-03d9-432a-b742-ef6527486b7b" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[65e3245d-5841-4cf2-8d56-8f0c79addb8c]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:02:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6811c654-d6bc-466b-8caa-f59bcfc67471 tempest-VolumesTestJSON-2016295332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ed90f4c2-03d9-432a-b742-ef6527486b7b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:48 devstack sudo[91987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ed90f4c2-03d9-432a-b742-ef6527486b7b Jul 09 10:02:48 devstack sudo[91987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:49 devstack sudo[91985]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-caa4114f-1a18-48af-bf26-a893abf19450 1073741824" returned: 0 in 0.963s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:49 devstack sudo[91987]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6811c654-d6bc-466b-8caa-f59bcfc67471 tempest-VolumesTestJSON-2016295332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ed90f4c2-03d9-432a-b742-ef6527486b7b" returned: 0 in 0.886s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6811c654-d6bc-466b-8caa-f59bcfc67471 tempest-VolumesTestJSON-2016295332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ed90f4c2-03d9-432a-b742-ef6527486b7b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:49 devstack sudo[92312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ed90f4c2-03d9-432a-b742-ef6527486b7b Jul 09 10:02:49 devstack sudo[92312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-caa4114f-1a18-48af-bf26-a893abf19450 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:49 devstack sudo[92314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-caa4114f-1a18-48af-bf26-a893abf19450 Jul 09 10:02:49 devstack sudo[92314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:49 devstack sudo[92312]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6811c654-d6bc-466b-8caa-f59bcfc67471 tempest-VolumesTestJSON-2016295332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ed90f4c2-03d9-432a-b742-ef6527486b7b" returned: 0 in 0.706s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:49 devstack sudo[92314]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-caa4114f-1a18-48af-bf26-a893abf19450" returned: 0 in 0.687s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] <== create_volume: return (1712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:02:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.715s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6811c654-d6bc-466b-8caa-f59bcfc67471 tempest-VolumesTestJSON-2016295332 None] Lock "cinder-quobyte-ed90f4c2-03d9-432a-b742-ef6527486b7b" released by "delete_volume" :: held 1.645s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e21d0cc-4287-4798-a5f1-778d950d0807) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caa4114f-1a18-48af-bf26-a893abf19450', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a284b6-5d11-4151-b305-42d4db39a5c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:49 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Volume volume-caa4114f-1a18-48af-bf26-a893abf19450 (caa4114f-1a18-48af-bf26-a893abf19450): created successfully Jul 09 10:02:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b4a284b6-5d11-4151-b305-42d4db39a5c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Flow 'volume_create_manager' (4a4cb254-0ad6-4ac4-b453-99442b29283f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:02:49 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-06485729-83f7-44d5-9dae-9782019228d4 tempest-VolumesTransfersV355Test-625622791 None] Created volume successfully. Jul 09 10:02:49 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-6811c654-d6bc-466b-8caa-f59bcfc67471 tempest-VolumesTestJSON-2016295332 None] Created reservations ['f120f59a-9393-4ee2-b7aa-98a3ee7aaf4b', '58aee3f0-a3b1-4fc1-8fa9-86ed21e9d292', 'd5cb7a08-bcd8-4c24-9f8b-3b7aa394ad26', 'f4d48e76-0ee1-46b3-bdec-75c158b68d98'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:02:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6811c654-d6bc-466b-8caa-f59bcfc67471 tempest-VolumesTestJSON-2016295332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6811c654-d6bc-466b-8caa-f59bcfc67471 tempest-VolumesTestJSON-2016295332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6811c654-d6bc-466b-8caa-f59bcfc67471 tempest-VolumesTestJSON-2016295332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6811c654-d6bc-466b-8caa-f59bcfc67471 tempest-VolumesTestJSON-2016295332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6811c654-d6bc-466b-8caa-f59bcfc67471 tempest-VolumesTestJSON-2016295332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6811c654-d6bc-466b-8caa-f59bcfc67471 tempest-VolumesTestJSON-2016295332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:50 devstack sudo[92318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:02:50 devstack sudo[92318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ea6c5c7e-1cef-4a6e-aa2f-29dcec84c694 tempest-VolumesTestJSON-2016295332 None] Acquiring lock "cinder-ad526a9a-c636-4d5c-8d92-2701e371b391-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:02:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ea6c5c7e-1cef-4a6e-aa2f-29dcec84c694 tempest-VolumesTestJSON-2016295332 None] Lock "cinder-ad526a9a-c636-4d5c-8d92-2701e371b391-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:02:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ea6c5c7e-1cef-4a6e-aa2f-29dcec84c694 tempest-VolumesTestJSON-2016295332 None] Acquiring lock "cinder-quobyte-ad526a9a-c636-4d5c-8d92-2701e371b391" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:02:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ea6c5c7e-1cef-4a6e-aa2f-29dcec84c694 tempest-VolumesTestJSON-2016295332 None] Lock "cinder-quobyte-ad526a9a-c636-4d5c-8d92-2701e371b391" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:02:50 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[898d0c81-c098-4847-bef0-875982df1a30]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:02:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ea6c5c7e-1cef-4a6e-aa2f-29dcec84c694 tempest-VolumesTestJSON-2016295332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad526a9a-c636-4d5c-8d92-2701e371b391 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:50 devstack sudo[92320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad526a9a-c636-4d5c-8d92-2701e371b391 Jul 09 10:02:50 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:50 devstack sudo[92318]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6811c654-d6bc-466b-8caa-f59bcfc67471 tempest-VolumesTestJSON-2016295332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.782s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:50 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-6811c654-d6bc-466b-8caa-f59bcfc67471 tempest-VolumesTestJSON-2016295332 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:02:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6811c654-d6bc-466b-8caa-f59bcfc67471 tempest-VolumesTestJSON-2016295332 None] Deleted volume successfully. Jul 09 10:02:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6811c654-d6bc-466b-8caa-f59bcfc67471 tempest-VolumesTestJSON-2016295332 None] Lock "cinder-ed90f4c2-03d9-432a-b742-ef6527486b7b-delete_volume" released by "delete_volume" :: held 2.702s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d60a7947-6bcd-4cac-b5d7-70472c5eafc6 tempest-VolumesTransfersV355Test-261811765 None] Transfer volume completed successfully. Jul 09 10:02:51 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ea6c5c7e-1cef-4a6e-aa2f-29dcec84c694 tempest-VolumesTestJSON-2016295332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad526a9a-c636-4d5c-8d92-2701e371b391" returned: 0 in 0.893s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ea6c5c7e-1cef-4a6e-aa2f-29dcec84c694 tempest-VolumesTestJSON-2016295332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad526a9a-c636-4d5c-8d92-2701e371b391 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:51 devstack sudo[92326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad526a9a-c636-4d5c-8d92-2701e371b391 Jul 09 10:02:51 devstack sudo[92326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7269537d-8084-47f1-9e98-9ccccae7b2d5 tempest-VolumesTransfersV355Test-735615533 None] Acquiring lock "cinder-caa4114f-1a18-48af-bf26-a893abf19450-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:02:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7269537d-8084-47f1-9e98-9ccccae7b2d5 tempest-VolumesTransfersV355Test-735615533 None] Lock "cinder-caa4114f-1a18-48af-bf26-a893abf19450-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:02:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7269537d-8084-47f1-9e98-9ccccae7b2d5 tempest-VolumesTransfersV355Test-735615533 None] Acquiring lock "cinder-quobyte-caa4114f-1a18-48af-bf26-a893abf19450" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:02:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7269537d-8084-47f1-9e98-9ccccae7b2d5 tempest-VolumesTransfersV355Test-735615533 None] Lock "cinder-quobyte-caa4114f-1a18-48af-bf26-a893abf19450" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:02:52 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[85f5b439-4298-44bb-827d-e98ca5ad823c]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:02:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7269537d-8084-47f1-9e98-9ccccae7b2d5 tempest-VolumesTransfersV355Test-735615533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-caa4114f-1a18-48af-bf26-a893abf19450 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:52 devstack sudo[92326]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ea6c5c7e-1cef-4a6e-aa2f-29dcec84c694 tempest-VolumesTestJSON-2016295332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad526a9a-c636-4d5c-8d92-2701e371b391" returned: 0 in 0.788s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ea6c5c7e-1cef-4a6e-aa2f-29dcec84c694 tempest-VolumesTestJSON-2016295332 None] Lock "cinder-quobyte-ad526a9a-c636-4d5c-8d92-2701e371b391" released by "delete_volume" :: held 1.725s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:52 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ea6c5c7e-1cef-4a6e-aa2f-29dcec84c694 tempest-VolumesTestJSON-2016295332 None] Created reservations ['7a0a97a8-d058-47cf-a9b4-b4e0df94d8b9', 'b04ac1f8-5ed0-4341-8dd3-019acd035990', 'cb34980d-120b-4fc1-acc0-b0ed7bd1ce02', 'ee70b070-e0f8-4c2a-b4b0-939dba70d1bd'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:02:52 devstack sudo[92331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-caa4114f-1a18-48af-bf26-a893abf19450 Jul 09 10:02:52 devstack sudo[92331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ea6c5c7e-1cef-4a6e-aa2f-29dcec84c694 tempest-VolumesTestJSON-2016295332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ea6c5c7e-1cef-4a6e-aa2f-29dcec84c694 tempest-VolumesTestJSON-2016295332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ea6c5c7e-1cef-4a6e-aa2f-29dcec84c694 tempest-VolumesTestJSON-2016295332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ea6c5c7e-1cef-4a6e-aa2f-29dcec84c694 tempest-VolumesTestJSON-2016295332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ea6c5c7e-1cef-4a6e-aa2f-29dcec84c694 tempest-VolumesTestJSON-2016295332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ea6c5c7e-1cef-4a6e-aa2f-29dcec84c694 tempest-VolumesTestJSON-2016295332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:52 devstack sudo[92335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:02:52 devstack sudo[92335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bf3e1dc7-9266-4644-8237-6efa40c34dd9 tempest-VolumesTestJSON-2016295332 None] Acquiring lock "cinder-27d8cb80-2bb9-4027-96c0-57d5a6e35400-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:02:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bf3e1dc7-9266-4644-8237-6efa40c34dd9 tempest-VolumesTestJSON-2016295332 None] Lock "cinder-27d8cb80-2bb9-4027-96c0-57d5a6e35400-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:02:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bf3e1dc7-9266-4644-8237-6efa40c34dd9 tempest-VolumesTestJSON-2016295332 None] Acquiring lock "cinder-quobyte-27d8cb80-2bb9-4027-96c0-57d5a6e35400" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:02:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bf3e1dc7-9266-4644-8237-6efa40c34dd9 tempest-VolumesTestJSON-2016295332 None] Lock "cinder-quobyte-27d8cb80-2bb9-4027-96c0-57d5a6e35400" acquired by "delete_volume" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:02:52 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5600147e-bf5e-4c99-afa2-d5bb417e0cf4]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:02:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bf3e1dc7-9266-4644-8237-6efa40c34dd9 tempest-VolumesTestJSON-2016295332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27d8cb80-2bb9-4027-96c0-57d5a6e35400 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:52 devstack sudo[92337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27d8cb80-2bb9-4027-96c0-57d5a6e35400 Jul 09 10:02:52 devstack sudo[92337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:53 devstack sudo[92331]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7269537d-8084-47f1-9e98-9ccccae7b2d5 tempest-VolumesTransfersV355Test-735615533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-caa4114f-1a18-48af-bf26-a893abf19450" returned: 0 in 0.986s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7269537d-8084-47f1-9e98-9ccccae7b2d5 tempest-VolumesTransfersV355Test-735615533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-caa4114f-1a18-48af-bf26-a893abf19450 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:53 devstack sudo[92343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-caa4114f-1a18-48af-bf26-a893abf19450 Jul 09 10:02:53 devstack sudo[92343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:53 devstack sudo[92335]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ea6c5c7e-1cef-4a6e-aa2f-29dcec84c694 tempest-VolumesTestJSON-2016295332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.964s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:53 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-ea6c5c7e-1cef-4a6e-aa2f-29dcec84c694 tempest-VolumesTestJSON-2016295332 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:02:53 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ea6c5c7e-1cef-4a6e-aa2f-29dcec84c694 tempest-VolumesTestJSON-2016295332 None] Deleted volume successfully. Jul 09 10:02:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ea6c5c7e-1cef-4a6e-aa2f-29dcec84c694 tempest-VolumesTestJSON-2016295332 None] Lock "cinder-ad526a9a-c636-4d5c-8d92-2701e371b391-delete_volume" released by "delete_volume" :: held 3.012s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:53 devstack sudo[92337]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bf3e1dc7-9266-4644-8237-6efa40c34dd9 tempest-VolumesTestJSON-2016295332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27d8cb80-2bb9-4027-96c0-57d5a6e35400" returned: 0 in 0.944s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bf3e1dc7-9266-4644-8237-6efa40c34dd9 tempest-VolumesTestJSON-2016295332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27d8cb80-2bb9-4027-96c0-57d5a6e35400 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:53 devstack sudo[92350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27d8cb80-2bb9-4027-96c0-57d5a6e35400 Jul 09 10:02:53 devstack sudo[92350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:53 devstack sudo[92343]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7269537d-8084-47f1-9e98-9ccccae7b2d5 tempest-VolumesTransfersV355Test-735615533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-caa4114f-1a18-48af-bf26-a893abf19450" returned: 0 in 0.767s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7269537d-8084-47f1-9e98-9ccccae7b2d5 tempest-VolumesTransfersV355Test-735615533 None] Lock "cinder-quobyte-caa4114f-1a18-48af-bf26-a893abf19450" released by "delete_volume" :: held 1.810s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:53 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-7269537d-8084-47f1-9e98-9ccccae7b2d5 tempest-VolumesTransfersV355Test-735615533 None] Created reservations ['b214493f-d2e2-4aee-8118-41f160528f1f', 'a9ecff74-4242-45a2-8067-ded332403d0c', 'bded7fa3-f1a4-49ad-b54b-87379c8c2680', '42cc7d77-9a98-4e11-a751-7c846a693549'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:02:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7269537d-8084-47f1-9e98-9ccccae7b2d5 tempest-VolumesTransfersV355Test-735615533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7269537d-8084-47f1-9e98-9ccccae7b2d5 tempest-VolumesTransfersV355Test-735615533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7269537d-8084-47f1-9e98-9ccccae7b2d5 tempest-VolumesTransfersV355Test-735615533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7269537d-8084-47f1-9e98-9ccccae7b2d5 tempest-VolumesTransfersV355Test-735615533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7269537d-8084-47f1-9e98-9ccccae7b2d5 tempest-VolumesTransfersV355Test-735615533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7269537d-8084-47f1-9e98-9ccccae7b2d5 tempest-VolumesTransfersV355Test-735615533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:54 devstack sudo[92352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:02:54 devstack sudo[92352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:54 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-be9459e3-d2a2-4fba-9186-5234011f01e4 req-91abee15-2998-4b85-9403-b821d1f5397f tempest-TaggedAttachmentsTest-420306876 None] Terminate volume connection completed successfully. Jul 09 10:02:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-be9459e3-d2a2-4fba-9186-5234011f01e4 req-91abee15-2998-4b85-9403-b821d1f5397f tempest-TaggedAttachmentsTest-420306876 None] Deleting attachment 01a7e69a-4801-453b-aa62-0f1779e6784d. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:02:54 devstack sudo[92350]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bf3e1dc7-9266-4644-8237-6efa40c34dd9 tempest-VolumesTestJSON-2016295332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27d8cb80-2bb9-4027-96c0-57d5a6e35400" returned: 0 in 0.949s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bf3e1dc7-9266-4644-8237-6efa40c34dd9 tempest-VolumesTestJSON-2016295332 None] Lock "cinder-quobyte-27d8cb80-2bb9-4027-96c0-57d5a6e35400" released by "delete_volume" :: held 1.954s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:54 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-bf3e1dc7-9266-4644-8237-6efa40c34dd9 tempest-VolumesTestJSON-2016295332 None] Created reservations ['89452682-9f3e-4b62-b5b3-cbd97fd9c39d', 'c8d5c8bb-e88c-48a2-8f85-c58c8496389f', '8cbc9514-8c19-4304-aa53-a93a35c4f00a', 'f0c641e2-b697-4e19-ba21-77ec97612f3c'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:02:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bf3e1dc7-9266-4644-8237-6efa40c34dd9 tempest-VolumesTestJSON-2016295332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bf3e1dc7-9266-4644-8237-6efa40c34dd9 tempest-VolumesTestJSON-2016295332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bf3e1dc7-9266-4644-8237-6efa40c34dd9 tempest-VolumesTestJSON-2016295332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bf3e1dc7-9266-4644-8237-6efa40c34dd9 tempest-VolumesTestJSON-2016295332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bf3e1dc7-9266-4644-8237-6efa40c34dd9 tempest-VolumesTestJSON-2016295332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:54 devstack sudo[92352]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bf3e1dc7-9266-4644-8237-6efa40c34dd9 tempest-VolumesTestJSON-2016295332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7269537d-8084-47f1-9e98-9ccccae7b2d5 tempest-VolumesTransfersV355Test-735615533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.892s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:54 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-7269537d-8084-47f1-9e98-9ccccae7b2d5 tempest-VolumesTransfersV355Test-735615533 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:02:54 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7269537d-8084-47f1-9e98-9ccccae7b2d5 tempest-VolumesTransfersV355Test-735615533 None] Deleted volume successfully. Jul 09 10:02:54 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:02:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7269537d-8084-47f1-9e98-9ccccae7b2d5 tempest-VolumesTransfersV355Test-735615533 None] Lock "cinder-caa4114f-1a18-48af-bf26-a893abf19450-delete_volume" released by "delete_volume" :: held 2.961s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:54 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Flow 'volume_create_manager' (cfcf7aa0-460e-4843-b2e0-72f6532db659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c56820-9ba1-47e1-883b-c099fe03cdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73c56820-9ba1-47e1-883b-c099fe03cdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-665428787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f7bc9f-cfc5-4df5-a86c-717c29ae434d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585e371f00ea4f6fb9f13ceab7094896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:02:55Z,use_quota=True,user_id='af62de1fc6e44400a54b848910c42599',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c644b5-6597-4472-8125-7a70ae0bd0e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51c644b5-6597-4472-8125-7a70ae0bd0e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b8fc5a-8746-48d3-bfa2-d6e788b042c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (10b8fc5a-8746-48d3-bfa2-d6e788b042c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31f7bc9f-cfc5-4df5-a86c-717c29ae434d', 'volume_name': 'volume-31f7bc9f-cfc5-4df5-a86c-717c29ae434d', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06d0b70-1242-46c1-a12d-609a5af16cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e06d0b70-1242-46c1-a12d-609a5af16cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa747c61-4ddb-4f91-8a9b-662aa8f60973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:55 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Volume 31f7bc9f-cfc5-4df5-a86c-717c29ae434d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31f7bc9f-cfc5-4df5-a86c-717c29ae434d', 'volume_size': 1} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:02:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-665428787',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f7bc9f-cfc5-4df5-a86c-717c29ae434d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='585e371f00ea4f6fb9f13ceab7094896',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:02:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:02:55Z,use_quota=True,user_id='af62de1fc6e44400a54b848910c42599',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Creating volume 31f7bc9f-cfc5-4df5-a86c-717c29ae434d {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:02:55 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-31f7bc9f-cfc5-4df5-a86c-717c29ae434d 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:55 devstack sudo[92388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-31f7bc9f-cfc5-4df5-a86c-717c29ae434d 1073741824 Jul 09 10:02:55 devstack sudo[92388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:55 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bf3e1dc7-9266-4644-8237-6efa40c34dd9 tempest-VolumesTestJSON-2016295332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.041s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:55 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-bf3e1dc7-9266-4644-8237-6efa40c34dd9 tempest-VolumesTestJSON-2016295332 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:02:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-bf3e1dc7-9266-4644-8237-6efa40c34dd9 tempest-VolumesTestJSON-2016295332 None] Deleted volume successfully. Jul 09 10:02:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bf3e1dc7-9266-4644-8237-6efa40c34dd9 tempest-VolumesTestJSON-2016295332 None] Lock "cinder-27d8cb80-2bb9-4027-96c0-57d5a6e35400-delete_volume" released by "delete_volume" :: held 3.314s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:56 devstack sudo[92388]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-31f7bc9f-cfc5-4df5-a86c-717c29ae434d 1073741824" returned: 0 in 1.079s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-31f7bc9f-cfc5-4df5-a86c-717c29ae434d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:56 devstack sudo[92396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-31f7bc9f-cfc5-4df5-a86c-717c29ae434d Jul 09 10:02:56 devstack sudo[92396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:57 devstack sudo[92396]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-31f7bc9f-cfc5-4df5-a86c-717c29ae434d" returned: 0 in 0.707s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] <== create_volume: return (1831ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:02:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.834s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fa747c61-4ddb-4f91-8a9b-662aa8f60973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31f7bc9f-cfc5-4df5-a86c-717c29ae434d', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8583dd8-4340-4c87-a698-7a64b3731df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:02:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Volume volume-31f7bc9f-cfc5-4df5-a86c-717c29ae434d (31f7bc9f-cfc5-4df5-a86c-717c29ae434d): created successfully Jul 09 10:02:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8583dd8-4340-4c87-a698-7a64b3731df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:02:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Flow 'volume_create_manager' (cfcf7aa0-460e-4843-b2e0-72f6532db659) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:02:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7986bfd8-f6fc-4486-99a9-1fef43cd1738 tempest-VolumesTransfersV355Test-625622791 None] Created volume successfully. Jul 09 10:02:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e5885cbd-5571-4bea-b4a3-b14eb2134750 tempest-VolumesTransfersV355Test-735615533 None] Acquiring lock "cinder-31f7bc9f-cfc5-4df5-a86c-717c29ae434d-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:02:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e5885cbd-5571-4bea-b4a3-b14eb2134750 tempest-VolumesTransfersV355Test-735615533 None] Lock "cinder-31f7bc9f-cfc5-4df5-a86c-717c29ae434d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:02:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e5885cbd-5571-4bea-b4a3-b14eb2134750 tempest-VolumesTransfersV355Test-735615533 None] Acquiring lock "cinder-quobyte-31f7bc9f-cfc5-4df5-a86c-717c29ae434d" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:02:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e5885cbd-5571-4bea-b4a3-b14eb2134750 tempest-VolumesTransfersV355Test-735615533 None] Lock "cinder-quobyte-31f7bc9f-cfc5-4df5-a86c-717c29ae434d" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:02:57 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[779ea5b2-061e-4a6c-ac43-86adea034f39]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:02:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e5885cbd-5571-4bea-b4a3-b14eb2134750 tempest-VolumesTransfersV355Test-735615533 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-31f7bc9f-cfc5-4df5-a86c-717c29ae434d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:57 devstack sudo[92417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-31f7bc9f-cfc5-4df5-a86c-717c29ae434d Jul 09 10:02:57 devstack sudo[92417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:58 devstack sudo[92417]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e5885cbd-5571-4bea-b4a3-b14eb2134750 tempest-VolumesTransfersV355Test-735615533 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-31f7bc9f-cfc5-4df5-a86c-717c29ae434d" returned: 0 in 1.010s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e5885cbd-5571-4bea-b4a3-b14eb2134750 tempest-VolumesTransfersV355Test-735615533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-31f7bc9f-cfc5-4df5-a86c-717c29ae434d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:58 devstack sudo[92424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-31f7bc9f-cfc5-4df5-a86c-717c29ae434d Jul 09 10:02:58 devstack sudo[92424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:02:59 devstack sudo[92424]: pam_unix(sudo:session): session closed for user root Jul 09 10:02:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e5885cbd-5571-4bea-b4a3-b14eb2134750 tempest-VolumesTransfersV355Test-735615533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-31f7bc9f-cfc5-4df5-a86c-717c29ae434d" returned: 0 in 0.663s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:02:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e5885cbd-5571-4bea-b4a3-b14eb2134750 tempest-VolumesTransfersV355Test-735615533 None] Lock "cinder-quobyte-31f7bc9f-cfc5-4df5-a86c-717c29ae434d" released by "delete_volume" :: held 1.723s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:02:59 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-e5885cbd-5571-4bea-b4a3-b14eb2134750 tempest-VolumesTransfersV355Test-735615533 None] Created reservations ['3f75e34c-f9dc-4986-9898-f80fe9fcac46', 'e7332a9e-4a53-4e62-a2c3-24bd0c438389', 'ece04462-2ba6-4f11-ba23-a568e017177c', '0cb36641-8bb7-4ec3-b7dc-793270e9769a'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:02:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e5885cbd-5571-4bea-b4a3-b14eb2134750 tempest-VolumesTransfersV355Test-735615533 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:02:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e5885cbd-5571-4bea-b4a3-b14eb2134750 tempest-VolumesTransfersV355Test-735615533 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:02:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e5885cbd-5571-4bea-b4a3-b14eb2134750 tempest-VolumesTransfersV355Test-735615533 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:02:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e5885cbd-5571-4bea-b4a3-b14eb2134750 tempest-VolumesTransfersV355Test-735615533 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:02:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e5885cbd-5571-4bea-b4a3-b14eb2134750 tempest-VolumesTransfersV355Test-735615533 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:02:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e5885cbd-5571-4bea-b4a3-b14eb2134750 tempest-VolumesTransfersV355Test-735615533 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:02:59 devstack sudo[92427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:02:59 devstack sudo[92427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f234adbb-b422-4aa2-b0fc-c5c45fde5cd8 tempest-GroupSnapshotsTest-1578681694 None] Group tempest-GroupSnapshotsTest-Group-1640616618: creating Jul 09 10:03:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f234adbb-b422-4aa2-b0fc-c5c45fde5cd8 tempest-GroupSnapshotsTest-1578681694 None] Group tempest-GroupSnapshotsTest-Group-1640616618: created successfully Jul 09 10:03:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f234adbb-b422-4aa2-b0fc-c5c45fde5cd8 tempest-GroupSnapshotsTest-1578681694 None] Create group completed successfully. Jul 09 10:03:00 devstack sudo[92427]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e5885cbd-5571-4bea-b4a3-b14eb2134750 tempest-VolumesTransfersV355Test-735615533 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.857s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:00 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-e5885cbd-5571-4bea-b4a3-b14eb2134750 tempest-VolumesTransfersV355Test-735615533 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:03:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e5885cbd-5571-4bea-b4a3-b14eb2134750 tempest-VolumesTransfersV355Test-735615533 None] Deleted volume successfully. Jul 09 10:03:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e5885cbd-5571-4bea-b4a3-b14eb2134750 tempest-VolumesTransfersV355Test-735615533 None] Lock "cinder-31f7bc9f-cfc5-4df5-a86c-717c29ae434d-delete_volume" released by "delete_volume" :: held 2.814s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:03:01 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:03:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Flow 'volume_create_manager' (b072cf5d-a9be-4713-bcec-64b743bc8b8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3e003d-7ea2-47f2-93ad-88a6f9e8568a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a3e003d-7ea2-47f2-93ad-88a6f9e8568a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-882089714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f7b20a4-e20d-4367-baeb-72a386fd0446,host='devstack@QuobyteHD#QuobyteHD',id=1cd3485e-2d62-48ec-92f2-44ba41aba4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61dd9b7eeda34863a3e4d6ea3aebf31b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:02Z,use_quota=True,user_id='67d9115aefc04410bc16e17cc27f4fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fccdf8e-0739-4b47-b953-dbd682e5c703),volume_type_id=2fccdf8e-0739-4b47-b953-dbd682e5c703)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b321a64-64ca-42ea-a86e-f107a83e72a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b321a64-64ca-42ea-a86e-f107a83e72a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d9090a4-df4a-481d-9ebc-4b13a9752b4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d9090a4-df4a-481d-9ebc-4b13a9752b4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1cd3485e-2d62-48ec-92f2-44ba41aba4f9', 'volume_name': 'volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5ca440-3b9d-4f42-b97b-e68c31d741a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d5ca440-3b9d-4f42-b97b-e68c31d741a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c77ebf71-bc10-4558-a6eb-5feb1de881f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:01 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Volume 1cd3485e-2d62-48ec-92f2-44ba41aba4f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9', 'volume_size': 1} Jul 09 10:03:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3f7b20a4-e20d-4367-baeb-72a386fd0446,created_at=2026-07-09T08:03:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-882089714',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3f7b20a4-e20d-4367-baeb-72a386fd0446,host='devstack@QuobyteHD#QuobyteHD',id=1cd3485e-2d62-48ec-92f2-44ba41aba4f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61dd9b7eeda34863a3e4d6ea3aebf31b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:02Z,use_quota=True,user_id='67d9115aefc04410bc16e17cc27f4fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2fccdf8e-0739-4b47-b953-dbd682e5c703),volume_type_id=2fccdf8e-0739-4b47-b953-dbd682e5c703)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:03:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Creating volume 1cd3485e-2d62-48ec-92f2-44ba41aba4f9 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:03:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:03:02 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:03:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:02 devstack sudo[92432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 1073741824 Jul 09 10:03:02 devstack sudo[92432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:02 devstack sudo[92432]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 1073741824" returned: 0 in 0.959s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:03 devstack sudo[92452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 Jul 09 10:03:03 devstack sudo[92452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:03 devstack sudo[92452]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9" returned: 0 in 0.751s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] <== create_volume: return (1770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:03:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.777s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c77ebf71-bc10-4558-a6eb-5feb1de881f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0a25e5-1a08-40c2-81a0-2e8e1bf0e7b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:03 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Volume volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 (1cd3485e-2d62-48ec-92f2-44ba41aba4f9): created successfully Jul 09 10:03:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9e0a25e5-1a08-40c2-81a0-2e8e1bf0e7b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Flow 'volume_create_manager' (b072cf5d-a9be-4713-bcec-64b743bc8b8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a20c71ee-9c88-45de-a5c0-c0a3d9358328 tempest-GroupSnapshotsTest-1578681694 None] Created volume successfully. Jul 09 10:03:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] GroupSnapshot 731f6dfb-59e0-4a85-b39e-bce54f482225: creating. Jul 09 10:03:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] Group snapshot 731f6dfb-59e0-4a85-b39e-bce54f482225: creating. {{(pid=87192) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 10:03:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] Creating offline snapshot 412ea49a-693c-4ecb-a7f7-c1f9856279e6 of volume 1cd3485e-2d62-48ec-92f2-44ba41aba4f9 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:03:04 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[26fc55ba-c891-431e-a94b-2e9453de966a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:03:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:04 devstack sudo[92458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 Jul 09 10:03:04 devstack sudo[92458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:05 devstack sudo[92458]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9" returned: 0 in 0.853s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:05 devstack sudo[92464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6 1G Jul 09 10:03:05 devstack sudo[92464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:06 devstack sudo[92464]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6 1G" returned: 0 in 0.867s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:06 devstack sudo[92477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6 Jul 09 10:03:06 devstack sudo[92477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:07 devstack sudo[92477]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6" returned: 0 in 1.066s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:07 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 10:03:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:07 devstack sudo[92525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6 Jul 09 10:03:07 devstack sudo[92525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:08 devstack sudo[92525]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6" returned: 0 in 0.857s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:08 devstack sudo[92545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.info Jul 09 10:03:08 devstack sudo[92545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:08 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:03:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Flow 'volume_create_manager' (2c92f686-d2a5-4777-9370-e106f2d06a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e517825a-eb5a-4daf-8913-a8bf314c6aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e517825a-eb5a-4daf-8913-a8bf314c6aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1410948745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6456fa05-8610-428c-8f74-792bb8eb81cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c784f6afee4a95917764049f28629c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:09Z,use_quota=True,user_id='6e97fec5d660471893029eb2f39a7a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a965a2-c159-40ba-969e-44cac714cd5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39a965a2-c159-40ba-969e-44cac714cd5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2dfa173-494d-466d-9dca-5263b6db54a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2dfa173-494d-466d-9dca-5263b6db54a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6456fa05-8610-428c-8f74-792bb8eb81cb', 'volume_name': 'volume-6456fa05-8610-428c-8f74-792bb8eb81cb', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c675e8-c69b-4c16-81e0-09a70c785696) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51c675e8-c69b-4c16-81e0-09a70c785696) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dedffc9-7653-450a-a60c-fdbfa0234ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Volume 6456fa05-8610-428c-8f74-792bb8eb81cb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6456fa05-8610-428c-8f74-792bb8eb81cb', 'volume_size': 1} Jul 09 10:03:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:09 devstack sudo[92545]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.info" returned: 0 in 0.881s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:09 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 10:03:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:09 devstack sudo[92568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.info Jul 09 10:03:09 devstack sudo[92568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:10 devstack sudo[92568]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.info" returned: 0 in 0.794s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.420s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.327s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:03:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1410948745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6456fa05-8610-428c-8f74-792bb8eb81cb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c784f6afee4a95917764049f28629c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:09Z,use_quota=True,user_id='6e97fec5d660471893029eb2f39a7a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:03:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Creating volume 6456fa05-8610-428c-8f74-792bb8eb81cb {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:03:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:03:10 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:03:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6456fa05-8610-428c-8f74-792bb8eb81cb 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:10 devstack sudo[92576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6456fa05-8610-428c-8f74-792bb8eb81cb 1073741824 Jul 09 10:03:10 devstack sudo[92576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:10 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-14ed8abb-1328-4eb5-835e-ffaf52a4dc14 tempest-GroupSnapshotsTest-1578681694 None] group_snapshot 731f6dfb-59e0-4a85-b39e-bce54f482225: created successfully Jul 09 10:03:11 devstack sudo[92576]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6456fa05-8610-428c-8f74-792bb8eb81cb 1073741824" returned: 0 in 0.980s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6456fa05-8610-428c-8f74-792bb8eb81cb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:11 devstack sudo[92581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6456fa05-8610-428c-8f74-792bb8eb81cb Jul 09 10:03:11 devstack sudo[92581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:12 devstack sudo[92581]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6456fa05-8610-428c-8f74-792bb8eb81cb" returned: 0 in 0.858s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] <== create_volume: return (1896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.901s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3dedffc9-7653-450a-a60c-fdbfa0234ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6456fa05-8610-428c-8f74-792bb8eb81cb', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720778e9-6ff4-41f2-a0b7-cade70448ddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:12 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Volume volume-6456fa05-8610-428c-8f74-792bb8eb81cb (6456fa05-8610-428c-8f74-792bb8eb81cb): created successfully Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (720778e9-6ff4-41f2-a0b7-cade70448ddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Flow 'volume_create_manager' (2c92f686-d2a5-4777-9370-e106f2d06a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:12 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-490cd985-d43b-4139-a161-f13ca83da3b9 tempest-VolumesTransfersV357Test-1739041961 None] Created volume successfully. Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=85,cinder:UPDATE=116,cinder:DELETE=7,cinder:INSERT=24 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "cinder-quobyte-412ea49a-693c-4ecb-a7f7-c1f9856279e6-c093e757-8d64-48d7-891e-d9dbed9a14eb" by "_create_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-412ea49a-693c-4ecb-a7f7-c1f9856279e6-c093e757-8d64-48d7-891e-d9dbed9a14eb" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Creating volume c093e757-8d64-48d7-891e-d9dbed9a14eb from snapshot 412ea49a-693c-4ecb-a7f7-c1f9856279e6 {{(pid=87192) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "cinder-quobyte-c093e757-8d64-48d7-891e-d9dbed9a14eb" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-c093e757-8d64-48d7-891e-d9dbed9a14eb" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] snapshot: 412ea49a-693c-4ecb-a7f7-c1f9856279e6, volume: c093e757-8d64-48d7-891e-d9dbed9a14eb, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[84a2cfd6-a40d-494b-8e55-5cb98cb3dd49]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:03:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:12 devstack sudo[92584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6 Jul 09 10:03:12 devstack sudo[92584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:13 devstack sudo[92584]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6" returned: 0 in 1.102s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:03:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 10:03:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 10:03:13 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2eb0fa-f81b-43e8-8055-fb93ce7ad73e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:03:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:13 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d3a4594e-1b26-42ce-a74f-01ce95ec8ff9 tempest-VolumesTransfersV357Test-337802013 None] Transfer volume completed successfully. Jul 09 10:03:13 devstack sudo[92589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 Jul 09 10:03:13 devstack sudo[92589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:14 devstack sudo[92589]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9" returned: 0 in 1.129s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:14 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Path /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c093e757-8d64-48d7-891e-d9dbed9a14eb not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 10:03:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c093e757-8d64-48d7-891e-d9dbed9a14eb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:15 devstack sudo[92596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c093e757-8d64-48d7-891e-d9dbed9a14eb Jul 09 10:03:15 devstack sudo[92596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff9eb4e4-aac6-4773-a669-87a5e214c56c tempest-VolumesTransfersV357Test-834069079 None] Acquiring lock "cinder-6456fa05-8610-428c-8f74-792bb8eb81cb-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:03:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff9eb4e4-aac6-4773-a669-87a5e214c56c tempest-VolumesTransfersV357Test-834069079 None] Lock "cinder-6456fa05-8610-428c-8f74-792bb8eb81cb-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:03:15 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=119,cinder:SELECT=93,cinder:INSERT=28,cinder:DELETE=14 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:03:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff9eb4e4-aac6-4773-a669-87a5e214c56c tempest-VolumesTransfersV357Test-834069079 None] Acquiring lock "cinder-quobyte-6456fa05-8610-428c-8f74-792bb8eb81cb" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:03:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff9eb4e4-aac6-4773-a669-87a5e214c56c tempest-VolumesTransfersV357Test-834069079 None] Lock "cinder-quobyte-6456fa05-8610-428c-8f74-792bb8eb81cb" acquired by "delete_volume" :: waited 0.042s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:03:15 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[90b87ca3-8a29-4b60-a20e-d1de88bb77a6]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:03:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff9eb4e4-aac6-4773-a669-87a5e214c56c tempest-VolumesTransfersV357Test-834069079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6456fa05-8610-428c-8f74-792bb8eb81cb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:15 devstack sudo[92598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6456fa05-8610-428c-8f74-792bb8eb81cb Jul 09 10:03:15 devstack sudo[92598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:17 devstack sudo[92598]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff9eb4e4-aac6-4773-a669-87a5e214c56c tempest-VolumesTransfersV357Test-834069079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6456fa05-8610-428c-8f74-792bb8eb81cb" returned: 0 in 1.755s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff9eb4e4-aac6-4773-a669-87a5e214c56c tempest-VolumesTransfersV357Test-834069079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6456fa05-8610-428c-8f74-792bb8eb81cb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:17 devstack sudo[92627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6456fa05-8610-428c-8f74-792bb8eb81cb Jul 09 10:03:17 devstack sudo[92627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-215795b0-acd2-4f37-8001-5150c767285b tempest-TaggedAttachmentsTest-420306876 None] Acquiring lock "cinder-b181a6b8-efc1-4603-9e71-25c44ec43953-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:03:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-215795b0-acd2-4f37-8001-5150c767285b tempest-TaggedAttachmentsTest-420306876 None] Lock "cinder-b181a6b8-efc1-4603-9e71-25c44ec43953-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:03:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-215795b0-acd2-4f37-8001-5150c767285b tempest-TaggedAttachmentsTest-420306876 None] Acquiring lock "cinder-quobyte-b181a6b8-efc1-4603-9e71-25c44ec43953" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:03:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-215795b0-acd2-4f37-8001-5150c767285b tempest-TaggedAttachmentsTest-420306876 None] Lock "cinder-quobyte-b181a6b8-efc1-4603-9e71-25c44ec43953" acquired by "delete_volume" :: waited 0.050s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:03:18 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[977848de-46ad-4a6c-b9f0-a35e330107e0]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:03:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-215795b0-acd2-4f37-8001-5150c767285b tempest-TaggedAttachmentsTest-420306876 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b181a6b8-efc1-4603-9e71-25c44ec43953 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:18 devstack sudo[92630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b181a6b8-efc1-4603-9e71-25c44ec43953 Jul 09 10:03:18 devstack sudo[92630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:19 devstack sudo[92627]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff9eb4e4-aac6-4773-a669-87a5e214c56c tempest-VolumesTransfersV357Test-834069079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6456fa05-8610-428c-8f74-792bb8eb81cb" returned: 0 in 2.300s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff9eb4e4-aac6-4773-a669-87a5e214c56c tempest-VolumesTransfersV357Test-834069079 None] Lock "cinder-quobyte-6456fa05-8610-428c-8f74-792bb8eb81cb" released by "delete_volume" :: held 4.136s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:03:19 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ff9eb4e4-aac6-4773-a669-87a5e214c56c tempest-VolumesTransfersV357Test-834069079 None] Created reservations ['52eb0515-2ed6-4ad3-8a55-1ebceeae65d8', '843a608e-e476-4778-b6a2-dd70e5a38e53', '9717006e-4b0a-439c-a5aa-3b64ee4c8d61', 'dd4c81d4-2373-479a-95ec-6ead113f4c46'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:03:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ff9eb4e4-aac6-4773-a669-87a5e214c56c tempest-VolumesTransfersV357Test-834069079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ff9eb4e4-aac6-4773-a669-87a5e214c56c tempest-VolumesTransfersV357Test-834069079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ff9eb4e4-aac6-4773-a669-87a5e214c56c tempest-VolumesTransfersV357Test-834069079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ff9eb4e4-aac6-4773-a669-87a5e214c56c tempest-VolumesTransfersV357Test-834069079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ff9eb4e4-aac6-4773-a669-87a5e214c56c tempest-VolumesTransfersV357Test-834069079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff9eb4e4-aac6-4773-a669-87a5e214c56c tempest-VolumesTransfersV357Test-834069079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:20 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:03:20 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:21 devstack sudo[92630]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-215795b0-acd2-4f37-8001-5150c767285b tempest-TaggedAttachmentsTest-420306876 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b181a6b8-efc1-4603-9e71-25c44ec43953" returned: 0 in 3.211s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-215795b0-acd2-4f37-8001-5150c767285b tempest-TaggedAttachmentsTest-420306876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b181a6b8-efc1-4603-9e71-25c44ec43953 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:21 devstack sudo[92650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b181a6b8-efc1-4603-9e71-25c44ec43953 Jul 09 10:03:21 devstack sudo[92650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:22 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff9eb4e4-aac6-4773-a669-87a5e214c56c tempest-VolumesTransfersV357Test-834069079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.926s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:22 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-ff9eb4e4-aac6-4773-a669-87a5e214c56c tempest-VolumesTransfersV357Test-834069079 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:03:22 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ff9eb4e4-aac6-4773-a669-87a5e214c56c tempest-VolumesTransfersV357Test-834069079 None] Deleted volume successfully. Jul 09 10:03:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff9eb4e4-aac6-4773-a669-87a5e214c56c tempest-VolumesTransfersV357Test-834069079 None] Lock "cinder-6456fa05-8610-428c-8f74-792bb8eb81cb-delete_volume" released by "delete_volume" :: held 6.976s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:03:22 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:03:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Flow 'volume_create_manager' (21fb9205-88fe-499b-9765-2bac4b9c6e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20099b1f-cd67-4f2e-a989-adad7f636114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20099b1f-cd67-4f2e-a989-adad7f636114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-314984922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e086bc9e-f326-44d3-9d40-05a4d48c0989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c784f6afee4a95917764049f28629c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:22Z,use_quota=True,user_id='6e97fec5d660471893029eb2f39a7a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6d27ba-31a5-4311-908f-76f8af5acbb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0c6d27ba-31a5-4311-908f-76f8af5acbb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04762a8e-7fb6-40f1-a91b-2328a4e7625e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04762a8e-7fb6-40f1-a91b-2328a4e7625e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e086bc9e-f326-44d3-9d40-05a4d48c0989', 'volume_name': 'volume-e086bc9e-f326-44d3-9d40-05a4d48c0989', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c91a2c1-d35d-4709-84a1-4ce60c771230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c91a2c1-d35d-4709-84a1-4ce60c771230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8473473-26f0-4a97-b4a0-4657cd25a6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:22 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Volume e086bc9e-f326-44d3-9d40-05a4d48c0989: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e086bc9e-f326-44d3-9d40-05a4d48c0989', 'volume_size': 1} Jul 09 10:03:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:23 devstack sudo[92650]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-215795b0-acd2-4f37-8001-5150c767285b tempest-TaggedAttachmentsTest-420306876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b181a6b8-efc1-4603-9e71-25c44ec43953" returned: 0 in 1.969s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-215795b0-acd2-4f37-8001-5150c767285b tempest-TaggedAttachmentsTest-420306876 None] Lock "cinder-quobyte-b181a6b8-efc1-4603-9e71-25c44ec43953" released by "delete_volume" :: held 5.329s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:03:23 devstack sudo[92596]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c093e757-8d64-48d7-891e-d9dbed9a14eb" returned: 0 in 8.527s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:23 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af83464-43c1-4ad8-8f36-00ace4d3f18e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:03:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:23 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-215795b0-acd2-4f37-8001-5150c767285b tempest-TaggedAttachmentsTest-420306876 None] Created reservations ['ada9b8f3-2fd3-43a5-8d15-45c88f67f37d', 'd2ae7589-81f0-4660-9d84-37ae377134dc', '0cd265f1-9885-4273-b81d-3eab4264561d', '082b2149-bc71-4154-a2ff-7592497bc620'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:03:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-215795b0-acd2-4f37-8001-5150c767285b tempest-TaggedAttachmentsTest-420306876 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-215795b0-acd2-4f37-8001-5150c767285b tempest-TaggedAttachmentsTest-420306876 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-215795b0-acd2-4f37-8001-5150c767285b tempest-TaggedAttachmentsTest-420306876 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-215795b0-acd2-4f37-8001-5150c767285b tempest-TaggedAttachmentsTest-420306876 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-215795b0-acd2-4f37-8001-5150c767285b tempest-TaggedAttachmentsTest-420306876 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-215795b0-acd2-4f37-8001-5150c767285b tempest-TaggedAttachmentsTest-420306876 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:23 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:03:23 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:23 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 Jul 09 10:03:23 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:24 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-215795b0-acd2-4f37-8001-5150c767285b tempest-TaggedAttachmentsTest-420306876 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.665s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:24 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-215795b0-acd2-4f37-8001-5150c767285b tempest-TaggedAttachmentsTest-420306876 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:03:24 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-215795b0-acd2-4f37-8001-5150c767285b tempest-TaggedAttachmentsTest-420306876 None] Deleted volume successfully. Jul 09 10:03:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-215795b0-acd2-4f37-8001-5150c767285b tempest-TaggedAttachmentsTest-420306876 None] Lock "cinder-b181a6b8-efc1-4603-9e71-25c44ec43953-delete_volume" released by "delete_volume" :: held 6.306s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:03:24 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9" returned: 0 in 0.992s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:24 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Image conversion details: src /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9, size 1024.00 MB, duration 8.53 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c093e757-8d64-48d7-891e-d9dbed9a14eb {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:03:24 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Converted 1024.00 MB image at 120.04 MB/s Jul 09 10:03:24 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c093e757-8d64-48d7-891e-d9dbed9a14eb is being set with open permissions: ugo+rw: NotImplementedError Jul 09 10:03:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c093e757-8d64-48d7-891e-d9dbed9a14eb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:24 devstack sudo[92720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c093e757-8d64-48d7-891e-d9dbed9a14eb Jul 09 10:03:24 devstack sudo[92720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:25 devstack sudo[92720]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c093e757-8d64-48d7-891e-d9dbed9a14eb" returned: 0 in 0.657s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-c093e757-8d64-48d7-891e-d9dbed9a14eb" released by "_copy_volume_from_snapshot" :: held 12.616s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:03:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-412ea49a-693c-4ecb-a7f7-c1f9856279e6-c093e757-8d64-48d7-891e-d9dbed9a14eb" released by "_create_volume_from_snapshot" :: held 12.659s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:03:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.677s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.584s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-314984922',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e086bc9e-f326-44d3-9d40-05a4d48c0989,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c7c784f6afee4a95917764049f28629c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:22Z,use_quota=True,user_id='6e97fec5d660471893029eb2f39a7a4b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:03:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Creating volume e086bc9e-f326-44d3-9d40-05a4d48c0989 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:03:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:03:25 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:03:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e086bc9e-f326-44d3-9d40-05a4d48c0989 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:25 devstack sudo[92723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e086bc9e-f326-44d3-9d40-05a4d48c0989 1073741824 Jul 09 10:03:25 devstack sudo[92723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:25 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f5c7e4f9-6f87-459a-b372-67f73b26b370 tempest-GroupSnapshotsTest-1578681694 None] Create group from source-snapshot-731f6dfb-59e0-4a85-b39e-bce54f482225 completed successfully. Jul 09 10:03:26 devstack sudo[92723]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e086bc9e-f326-44d3-9d40-05a4d48c0989 1073741824" returned: 0 in 0.855s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e086bc9e-f326-44d3-9d40-05a4d48c0989 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:26 devstack sudo[92729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e086bc9e-f326-44d3-9d40-05a4d48c0989 Jul 09 10:03:26 devstack sudo[92729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eb66e1a8-267b-4872-b36d-f46ce4f5a280 tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "cinder-quobyte-c093e757-8d64-48d7-891e-d9dbed9a14eb" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:03:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eb66e1a8-267b-4872-b36d-f46ce4f5a280 tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-c093e757-8d64-48d7-891e-d9dbed9a14eb" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:03:26 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0527776-8437-4c7c-9d66-82b0dc4e66c4]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:03:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb66e1a8-267b-4872-b36d-f46ce4f5a280 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c093e757-8d64-48d7-891e-d9dbed9a14eb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:26 devstack sudo[92731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c093e757-8d64-48d7-891e-d9dbed9a14eb Jul 09 10:03:26 devstack sudo[92731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:26 devstack sudo[92729]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e086bc9e-f326-44d3-9d40-05a4d48c0989" returned: 0 in 0.756s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] <== create_volume: return (1655ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:03:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.658s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8473473-26f0-4a97-b4a0-4657cd25a6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e086bc9e-f326-44d3-9d40-05a4d48c0989', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b53eb6-a579-4264-9005-770bdbc3bd95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:26 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Volume volume-e086bc9e-f326-44d3-9d40-05a4d48c0989 (e086bc9e-f326-44d3-9d40-05a4d48c0989): created successfully Jul 09 10:03:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (15b53eb6-a579-4264-9005-770bdbc3bd95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Flow 'volume_create_manager' (21fb9205-88fe-499b-9765-2bac4b9c6e5c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:26 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9dbea8d9-f7cc-4bdb-95aa-f58ba7ca2fc2 tempest-VolumesTransfersV357Test-1739041961 None] Created volume successfully. Jul 09 10:03:27 devstack sudo[92731]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb66e1a8-267b-4872-b36d-f46ce4f5a280 tempest-GroupSnapshotsTest-1578681694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c093e757-8d64-48d7-891e-d9dbed9a14eb" returned: 0 in 0.936s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb66e1a8-267b-4872-b36d-f46ce4f5a280 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c093e757-8d64-48d7-891e-d9dbed9a14eb {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:27 devstack sudo[92737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c093e757-8d64-48d7-891e-d9dbed9a14eb Jul 09 10:03:27 devstack sudo[92737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3a19c41b-751e-4a4d-949f-f811d5e747e1 tempest-VolumesTransfersV357Test-834069079 None] Acquiring lock "cinder-e086bc9e-f326-44d3-9d40-05a4d48c0989-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:03:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3a19c41b-751e-4a4d-949f-f811d5e747e1 tempest-VolumesTransfersV357Test-834069079 None] Lock "cinder-e086bc9e-f326-44d3-9d40-05a4d48c0989-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:03:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3a19c41b-751e-4a4d-949f-f811d5e747e1 tempest-VolumesTransfersV357Test-834069079 None] Acquiring lock "cinder-quobyte-e086bc9e-f326-44d3-9d40-05a4d48c0989" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:03:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3a19c41b-751e-4a4d-949f-f811d5e747e1 tempest-VolumesTransfersV357Test-834069079 None] Lock "cinder-quobyte-e086bc9e-f326-44d3-9d40-05a4d48c0989" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:03:27 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[83748a26-1a16-451e-aa94-03c3b8245a9f]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:03:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a19c41b-751e-4a4d-949f-f811d5e747e1 tempest-VolumesTransfersV357Test-834069079 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e086bc9e-f326-44d3-9d40-05a4d48c0989 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:27 devstack sudo[92741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e086bc9e-f326-44d3-9d40-05a4d48c0989 Jul 09 10:03:27 devstack sudo[92741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:28 devstack sudo[92737]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb66e1a8-267b-4872-b36d-f46ce4f5a280 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c093e757-8d64-48d7-891e-d9dbed9a14eb" returned: 0 in 0.811s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eb66e1a8-267b-4872-b36d-f46ce4f5a280 tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-c093e757-8d64-48d7-891e-d9dbed9a14eb" released by "delete_volume" :: held 1.807s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:03:28 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-eb66e1a8-267b-4872-b36d-f46ce4f5a280 tempest-GroupSnapshotsTest-1578681694 None] Created reservations ['aa926a6b-5efe-4f75-9f7c-b470c71e52ef'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:03:28 devstack cinder-volume[87192]: WARNING cinder.quota [None req-eb66e1a8-267b-4872-b36d-f46ce4f5a280 tempest-GroupSnapshotsTest-1578681694 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-955020340 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-955020340, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:03:28 devstack cinder-volume[87192]: WARNING cinder.quota [None req-eb66e1a8-267b-4872-b36d-f46ce4f5a280 tempest-GroupSnapshotsTest-1578681694 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-955020340 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-955020340, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:03:28 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-eb66e1a8-267b-4872-b36d-f46ce4f5a280 tempest-GroupSnapshotsTest-1578681694 None] Created reservations ['443c981a-bc0e-4227-8536-399b25960e6a', 'f9e7c7bc-49bb-4d2c-8ffe-a00ee1e1ac96', '24886e62-0931-4b46-99a4-f2302d67c574', 'eebd8614-094f-4a99-bdc2-3bdda9f63583'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:03:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eb66e1a8-267b-4872-b36d-f46ce4f5a280 tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eb66e1a8-267b-4872-b36d-f46ce4f5a280 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eb66e1a8-267b-4872-b36d-f46ce4f5a280 tempest-GroupSnapshotsTest-1578681694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eb66e1a8-267b-4872-b36d-f46ce4f5a280 tempest-GroupSnapshotsTest-1578681694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eb66e1a8-267b-4872-b36d-f46ce4f5a280 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb66e1a8-267b-4872-b36d-f46ce4f5a280 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:28 devstack sudo[92745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:03:28 devstack sudo[92745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:28 devstack sudo[92741]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a19c41b-751e-4a4d-949f-f811d5e747e1 tempest-VolumesTransfersV357Test-834069079 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e086bc9e-f326-44d3-9d40-05a4d48c0989" returned: 0 in 0.872s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a19c41b-751e-4a4d-949f-f811d5e747e1 tempest-VolumesTransfersV357Test-834069079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e086bc9e-f326-44d3-9d40-05a4d48c0989 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:28 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e086bc9e-f326-44d3-9d40-05a4d48c0989 Jul 09 10:03:28 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:28 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] group_snapshot 731f6dfb-59e0-4a85-b39e-bce54f482225: deleting Jul 09 10:03:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] group_snapshot 731f6dfb-59e0-4a85-b39e-bce54f482225: deleting {{(pid=87192) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 10:03:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "cinder-quobyte-1cd3485e-2d62-48ec-92f2-44ba41aba4f9" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:03:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-1cd3485e-2d62-48ec-92f2-44ba41aba4f9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "cinder-quobyte-412ea49a-693c-4ecb-a7f7-c1f9856279e6" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-412ea49a-693c-4ecb-a7f7-c1f9856279e6" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] Deleting offline snapshot 412ea49a-693c-4ecb-a7f7-c1f9856279e6 of volume 1cd3485e-2d62-48ec-92f2-44ba41aba4f9 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] snapshot_file for this snap is: volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc5d6667-82d0-41a6-bc6d-17718fb8c1ad]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:29 devstack sudo[92745]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb66e1a8-267b-4872-b36d-f46ce4f5a280 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.897s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-eb66e1a8-267b-4872-b36d-f46ce4f5a280 tempest-GroupSnapshotsTest-1578681694 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:03:29 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-eb66e1a8-267b-4872-b36d-f46ce4f5a280 tempest-GroupSnapshotsTest-1578681694 None] Delete group completed successfully. Jul 09 10:03:29 devstack sudo[92762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6 Jul 09 10:03:29 devstack sudo[92762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:29 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a19c41b-751e-4a4d-949f-f811d5e747e1 tempest-VolumesTransfersV357Test-834069079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e086bc9e-f326-44d3-9d40-05a4d48c0989" returned: 0 in 0.836s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3a19c41b-751e-4a4d-949f-f811d5e747e1 tempest-VolumesTransfersV357Test-834069079 None] Lock "cinder-quobyte-e086bc9e-f326-44d3-9d40-05a4d48c0989" released by "delete_volume" :: held 1.769s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-3a19c41b-751e-4a4d-949f-f811d5e747e1 tempest-VolumesTransfersV357Test-834069079 None] Created reservations ['159d2181-b58e-492f-ac2d-d3ff39e0d650', '1aa943a2-594d-4951-8330-360b66354c46', '8e84da2f-2050-4b69-b6f3-e5490dafbd4b', 'd6494108-c425-4915-98db-c3352fd66fee'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a19c41b-751e-4a4d-949f-f811d5e747e1 tempest-VolumesTransfersV357Test-834069079 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a19c41b-751e-4a4d-949f-f811d5e747e1 tempest-VolumesTransfersV357Test-834069079 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3a19c41b-751e-4a4d-949f-f811d5e747e1 tempest-VolumesTransfersV357Test-834069079 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3a19c41b-751e-4a4d-949f-f811d5e747e1 tempest-VolumesTransfersV357Test-834069079 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a19c41b-751e-4a4d-949f-f811d5e747e1 tempest-VolumesTransfersV357Test-834069079 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a19c41b-751e-4a4d-949f-f811d5e747e1 tempest-VolumesTransfersV357Test-834069079 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:29 devstack sudo[92765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:03:29 devstack sudo[92765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:29 devstack sudo[92768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:03:29 devstack sudo[92768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:30 devstack sudo[92762]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6" returned: 0 in 0.973s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:03:30 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c540cbf-0817-41b5-aa1a-db956dd42310]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:03:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:30 devstack sudo[92773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 Jul 09 10:03:30 devstack sudo[92773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:30 devstack sudo[92765]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a19c41b-751e-4a4d-949f-f811d5e747e1 tempest-VolumesTransfersV357Test-834069079 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.045s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-3a19c41b-751e-4a4d-949f-f811d5e747e1 tempest-VolumesTransfersV357Test-834069079 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:03:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3a19c41b-751e-4a4d-949f-f811d5e747e1 tempest-VolumesTransfersV357Test-834069079 None] Deleted volume successfully. Jul 09 10:03:30 devstack sudo[92768]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.978s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:03:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:03:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 8 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:03:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:03:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3a19c41b-751e-4a4d-949f-f811d5e747e1 tempest-VolumesTransfersV357Test-834069079 None] Lock "cinder-e086bc9e-f326-44d3-9d40-05a4d48c0989-delete_volume" released by "delete_volume" :: held 3.088s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:03:31 devstack sudo[92773]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9" returned: 0 in 1.023s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:31 devstack sudo[92780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6 Jul 09 10:03:31 devstack sudo[92780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:32 devstack sudo[92780]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6" returned: 0 in 1.000s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:32 devstack sudo[92786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6 Jul 09 10:03:32 devstack sudo[92786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:33 devstack sudo[92786]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9.412ea49a-693c-4ecb-a7f7-c1f9856279e6" returned: 0 in 0.906s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-412ea49a-693c-4ecb-a7f7-c1f9856279e6" released by "_delete_snapshot" :: held 4.045s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:03:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-1cd3485e-2d62-48ec-92f2-44ba41aba4f9" released by "delete_snapshot" :: held 4.084s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:03:33 devstack cinder-volume[87192]: WARNING cinder.quota [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-955020340 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-955020340, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:03:33 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] Created reservations ['2aefc987-0e70-4114-9be1-1cf8fed83a78', 'b3829bf7-7394-4bfe-9879-3797bc1e3ed7', '7ab3814e-b5f1-4316-aab2-e7db577b4059', '11bd907b-c339-4c7d-92ec-3638ebc59df6'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:03:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8cad93e1-c474-4932-8536-03b5928c7479 tempest-GroupSnapshotsTest-1578681694 None] group_snapshot 731f6dfb-59e0-4a85-b39e-bce54f482225: deleted successfully Jul 09 10:03:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a381d3ca-ec38-4b51-a220-41c5b4989944 tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "cinder-quobyte-1cd3485e-2d62-48ec-92f2-44ba41aba4f9" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:03:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a381d3ca-ec38-4b51-a220-41c5b4989944 tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-1cd3485e-2d62-48ec-92f2-44ba41aba4f9" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:03:33 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc1c4b25-370d-4c95-b20e-b781177ac0db]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:03:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a381d3ca-ec38-4b51-a220-41c5b4989944 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:34 devstack sudo[92790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 Jul 09 10:03:34 devstack sudo[92790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:35 devstack sudo[92790]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a381d3ca-ec38-4b51-a220-41c5b4989944 tempest-GroupSnapshotsTest-1578681694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9" returned: 0 in 1.101s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a381d3ca-ec38-4b51-a220-41c5b4989944 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:35 devstack sudo[92797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9 Jul 09 10:03:35 devstack sudo[92797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Flow 'volume_create_manager' (634b1e62-fbfd-459b-8928-4bbc875caa75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a77731b3-4c4f-4435-ba23-35a7acbc62d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a77731b3-4c4f-4435-ba23-35a7acbc62d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1245423978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=948225f6-9da0-4dbd-9888-9548426f85fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6535348d09554b1baacdd0035a971a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:35Z,use_quota=True,user_id='81895a280ee24d5e81ba3dc5ed0a3f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc080494-6621-4f85-bd6c-f0edd488acca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc080494-6621-4f85-bd6c-f0edd488acca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fe6674-815c-4871-8fd1-6de5c86a1a05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78fe6674-815c-4871-8fd1-6de5c86a1a05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '948225f6-9da0-4dbd-9888-9548426f85fe', 'volume_name': 'volume-948225f6-9da0-4dbd-9888-9548426f85fe', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f02b86-cc13-475b-849f-7b58ed0a9e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1f02b86-cc13-475b-849f-7b58ed0a9e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b98a34b-77a2-44dd-b242-83def049274f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:35 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Volume 948225f6-9da0-4dbd-9888-9548426f85fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-948225f6-9da0-4dbd-9888-9548426f85fe', 'volume_size': 1} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:03:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1245423978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=948225f6-9da0-4dbd-9888-9548426f85fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6535348d09554b1baacdd0035a971a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:35Z,use_quota=True,user_id='81895a280ee24d5e81ba3dc5ed0a3f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Creating volume 948225f6-9da0-4dbd-9888-9548426f85fe {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:03:35 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-948225f6-9da0-4dbd-9888-9548426f85fe 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:35 devstack sudo[92799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-948225f6-9da0-4dbd-9888-9548426f85fe 1073741824 Jul 09 10:03:35 devstack sudo[92799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:35 devstack sudo[92797]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a381d3ca-ec38-4b51-a220-41c5b4989944 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1cd3485e-2d62-48ec-92f2-44ba41aba4f9" returned: 0 in 0.808s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a381d3ca-ec38-4b51-a220-41c5b4989944 tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-1cd3485e-2d62-48ec-92f2-44ba41aba4f9" released by "delete_volume" :: held 2.013s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:03:35 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a381d3ca-ec38-4b51-a220-41c5b4989944 tempest-GroupSnapshotsTest-1578681694 None] Created reservations ['39cd04f7-4327-4d09-8c6f-1cc709f3f81a'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:03:36 devstack cinder-volume[87192]: WARNING cinder.db.api [None req-a381d3ca-ec38-4b51-a220-41c5b4989944 tempest-GroupSnapshotsTest-1578681694 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-955020340'] Jul 09 10:03:36 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a381d3ca-ec38-4b51-a220-41c5b4989944 tempest-GroupSnapshotsTest-1578681694 None] Created reservations ['9bd7fd0b-d0d7-4536-b112-bd76bc729482', '58cff42f-1e38-4c62-9bf7-56d8d67ff19a', '0a1a6560-e7f9-49bd-bcde-941a82ab5ff1', 'a0e6531a-68f7-40e3-a3e3-cbd15c8d4498'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:03:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a381d3ca-ec38-4b51-a220-41c5b4989944 tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a381d3ca-ec38-4b51-a220-41c5b4989944 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a381d3ca-ec38-4b51-a220-41c5b4989944 tempest-GroupSnapshotsTest-1578681694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a381d3ca-ec38-4b51-a220-41c5b4989944 tempest-GroupSnapshotsTest-1578681694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a381d3ca-ec38-4b51-a220-41c5b4989944 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a381d3ca-ec38-4b51-a220-41c5b4989944 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:36 devstack sudo[92806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:03:36 devstack sudo[92806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:36 devstack sudo[92799]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-948225f6-9da0-4dbd-9888-9548426f85fe 1073741824" returned: 0 in 1.048s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-948225f6-9da0-4dbd-9888-9548426f85fe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:36 devstack sudo[92808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-948225f6-9da0-4dbd-9888-9548426f85fe Jul 09 10:03:36 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:36 devstack sudo[92806]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a381d3ca-ec38-4b51-a220-41c5b4989944 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.825s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a381d3ca-ec38-4b51-a220-41c5b4989944 tempest-GroupSnapshotsTest-1578681694 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:03:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a381d3ca-ec38-4b51-a220-41c5b4989944 tempest-GroupSnapshotsTest-1578681694 None] Delete group completed successfully. Jul 09 10:03:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a2cbfaca-dd61-4dc9-adf1-99b7bf6470d1 tempest-GroupSnapshotsTest-1578681694 None] Group tempest-GroupSnapshotsTest-Group-519051598: creating Jul 09 10:03:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a2cbfaca-dd61-4dc9-adf1-99b7bf6470d1 tempest-GroupSnapshotsTest-1578681694 None] Group tempest-GroupSnapshotsTest-Group-519051598: created successfully Jul 09 10:03:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a2cbfaca-dd61-4dc9-adf1-99b7bf6470d1 tempest-GroupSnapshotsTest-1578681694 None] Create group completed successfully. Jul 09 10:03:37 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-948225f6-9da0-4dbd-9888-9548426f85fe" returned: 0 in 0.980s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] <== create_volume: return (2087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.089s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b98a34b-77a2-44dd-b242-83def049274f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-948225f6-9da0-4dbd-9888-9548426f85fe', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ad730b-1711-4689-a466-41e8f17bae83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:37 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Volume volume-948225f6-9da0-4dbd-9888-9548426f85fe (948225f6-9da0-4dbd-9888-9548426f85fe): created successfully Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9ad730b-1711-4689-a466-41e8f17bae83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Flow 'volume_create_manager' (634b1e62-fbfd-459b-8928-4bbc875caa75) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2ead1cdc-90a6-4687-8698-c27a65703dd4 tempest-AttachVolumeTestJSON-1815239661 None] Created volume successfully. Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Flow 'volume_create_manager' (22bda2e1-f74c-47d1-a8ec-d37cedb3b160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767b2eb3-fe10-4034-bb85-939cd49fea36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (767b2eb3-fe10-4034-bb85-939cd49fea36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-559885470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8603df2-f68c-42d5-a9c9-48e44249d02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1106698b3c5e4b44ac6756c7b7831278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:38Z,use_quota=True,user_id='97a1a68e93a44aa8a9d81c91f56458ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0a1925-6ed2-4c5f-b6bd-f311480aae79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd0a1925-6ed2-4c5f-b6bd-f311480aae79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7bdb70-94e4-41c9-896d-eae4069d36f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a7bdb70-94e4-41c9-896d-eae4069d36f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f8603df2-f68c-42d5-a9c9-48e44249d02f', 'volume_name': 'volume-f8603df2-f68c-42d5-a9c9-48e44249d02f', 'volume_size': 2}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07259eec-4e9d-4d7d-a28e-137a7854b1c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (07259eec-4e9d-4d7d-a28e-137a7854b1c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636c3ae0-07b8-4bc7-8c43-f531c3a25002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:37 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Volume f8603df2-f68c-42d5-a9c9-48e44249d02f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f8603df2-f68c-42d5-a9c9-48e44249d02f', 'volume_size': 2} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:03:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-559885470',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f8603df2-f68c-42d5-a9c9-48e44249d02f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1106698b3c5e4b44ac6756c7b7831278',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:38Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:38Z,use_quota=True,user_id='97a1a68e93a44aa8a9d81c91f56458ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Creating volume f8603df2-f68c-42d5-a9c9-48e44249d02f {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:03:37 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:03:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f8603df2-f68c-42d5-a9c9-48e44249d02f 2147483648 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:37 devstack sudo[92813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f8603df2-f68c-42d5-a9c9-48e44249d02f 2147483648 Jul 09 10:03:37 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:38 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f8603df2-f68c-42d5-a9c9-48e44249d02f 2147483648" returned: 0 in 1.152s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:38 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:03:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Flow 'volume_create_manager' (f7610700-f8cc-4dea-9b83-248366c74643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c334b593-76b5-4fe9-8f0a-db7ff2033dda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c334b593-76b5-4fe9-8f0a-db7ff2033dda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1373757047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a15b18c-c4a6-4c54-9226-80ec4f56e06c,host='devstack@QuobyteHD#QuobyteHD',id=89962e82-57fe-4619-84c8-5712a69a60b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61dd9b7eeda34863a3e4d6ea3aebf31b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:39Z,use_quota=True,user_id='67d9115aefc04410bc16e17cc27f4fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14f3f48c-46fd-4576-826c-967f0c1b56af),volume_type_id=14f3f48c-46fd-4576-826c-967f0c1b56af)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8c814b-e053-4ff9-a7e5-48aa6b5d3572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d8c814b-e053-4ff9-a7e5-48aa6b5d3572) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783c1d53-44e8-4208-a86f-321e1e857bf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (783c1d53-44e8-4208-a86f-321e1e857bf3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89962e82-57fe-4619-84c8-5712a69a60b7', 'volume_name': 'volume-89962e82-57fe-4619-84c8-5712a69a60b7', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f526dc-08f2-458c-beac-6cfef3114894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2f526dc-08f2-458c-beac-6cfef3114894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af5bf7a-cea5-4528-8cbc-ee5f632a2fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:39 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Volume 89962e82-57fe-4619-84c8-5712a69a60b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89962e82-57fe-4619-84c8-5712a69a60b7', 'volume_size': 1} Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f8603df2-f68c-42d5-a9c9-48e44249d02f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:39 devstack sudo[92823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f8603df2-f68c-42d5-a9c9-48e44249d02f Jul 09 10:03:39 devstack sudo[92823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:39 devstack sudo[92823]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f8603df2-f68c-42d5-a9c9-48e44249d02f" returned: 0 in 0.661s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.956s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.671s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0a15b18c-c4a6-4c54-9226-80ec4f56e06c,created_at=2026-07-09T08:03:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1373757047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a15b18c-c4a6-4c54-9226-80ec4f56e06c,host='devstack@QuobyteHD#QuobyteHD',id=89962e82-57fe-4619-84c8-5712a69a60b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61dd9b7eeda34863a3e4d6ea3aebf31b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:39Z,use_quota=True,user_id='67d9115aefc04410bc16e17cc27f4fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14f3f48c-46fd-4576-826c-967f0c1b56af),volume_type_id=14f3f48c-46fd-4576-826c-967f0c1b56af)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Creating volume 89962e82-57fe-4619-84c8-5712a69a60b7 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:03:39 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (636c3ae0-07b8-4bc7-8c43-f531c3a25002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f8603df2-f68c-42d5-a9c9-48e44249d02f', 'volume_size': 2}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:39 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7 1073741824 Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64322857-b9c6-4757-b4db-14dfd33d7432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:39 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:39 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Volume volume-f8603df2-f68c-42d5-a9c9-48e44249d02f (f8603df2-f68c-42d5-a9c9-48e44249d02f): created successfully Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64322857-b9c6-4757-b4db-14dfd33d7432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Flow 'volume_create_manager' (22bda2e1-f74c-47d1-a8ec-d37cedb3b160) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:39 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e0c4c5cd-2f50-4946-b873-1a3ab9e30325 tempest-VolumesCloneNegativeTest-104555850 None] Created volume successfully. Jul 09 10:03:40 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7 1073741824" returned: 0 in 0.864s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:40 devstack sudo[92833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7 Jul 09 10:03:40 devstack sudo[92833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5d6f4d00-7686-4ccf-b0b4-bd868632e22f tempest-VolumesCloneNegativeTest-104555850 None] Acquiring lock "cinder-f8603df2-f68c-42d5-a9c9-48e44249d02f-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:03:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5d6f4d00-7686-4ccf-b0b4-bd868632e22f tempest-VolumesCloneNegativeTest-104555850 None] Lock "cinder-f8603df2-f68c-42d5-a9c9-48e44249d02f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:03:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5d6f4d00-7686-4ccf-b0b4-bd868632e22f tempest-VolumesCloneNegativeTest-104555850 None] Acquiring lock "cinder-quobyte-f8603df2-f68c-42d5-a9c9-48e44249d02f" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:03:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5d6f4d00-7686-4ccf-b0b4-bd868632e22f tempest-VolumesCloneNegativeTest-104555850 None] Lock "cinder-quobyte-f8603df2-f68c-42d5-a9c9-48e44249d02f" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:03:41 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[16ee15b8-e0fa-4ea9-afa0-d3c4be308715]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:03:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5d6f4d00-7686-4ccf-b0b4-bd868632e22f tempest-VolumesCloneNegativeTest-104555850 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f8603df2-f68c-42d5-a9c9-48e44249d02f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:41 devstack sudo[92841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f8603df2-f68c-42d5-a9c9-48e44249d02f Jul 09 10:03:41 devstack sudo[92841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:41 devstack sudo[92833]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7" returned: 0 in 0.873s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] <== create_volume: return (1781ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:03:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6af5bf7a-cea5-4528-8cbc-ee5f632a2fb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89962e82-57fe-4619-84c8-5712a69a60b7', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6d3ee2-ed01-4ba7-bf70-4aced5f97bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:41 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Volume volume-89962e82-57fe-4619-84c8-5712a69a60b7 (89962e82-57fe-4619-84c8-5712a69a60b7): created successfully Jul 09 10:03:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a6d3ee2-ed01-4ba7-bf70-4aced5f97bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Flow 'volume_create_manager' (f7610700-f8cc-4dea-9b83-248366c74643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-885917db-0a44-4ac3-9cd5-2118814a1aab req-5617e2fa-a76d-441f-9211-041dad5bff57 tempest-AttachVolumeTestJSON-1815239661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-885917db-0a44-4ac3-9cd5-2118814a1aab req-5617e2fa-a76d-441f-9211-041dad5bff57 tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:41 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-cc6fb60f-eea9-4e3e-876e-d733c69a8f05 tempest-GroupSnapshotsTest-1578681694 None] Created volume successfully. Jul 09 10:03:41 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1bc1616-483a-450a-bd30-a4dcb06a9cf8]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:03:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-885917db-0a44-4ac3-9cd5-2118814a1aab req-5617e2fa-a76d-441f-9211-041dad5bff57 tempest-AttachVolumeTestJSON-1815239661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-948225f6-9da0-4dbd-9888-9548426f85fe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:41 devstack sudo[92852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-948225f6-9da0-4dbd-9888-9548426f85fe Jul 09 10:03:41 devstack sudo[92852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:42 devstack sudo[92841]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5d6f4d00-7686-4ccf-b0b4-bd868632e22f tempest-VolumesCloneNegativeTest-104555850 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f8603df2-f68c-42d5-a9c9-48e44249d02f" returned: 0 in 1.076s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5d6f4d00-7686-4ccf-b0b4-bd868632e22f tempest-VolumesCloneNegativeTest-104555850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f8603df2-f68c-42d5-a9c9-48e44249d02f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:42 devstack sudo[92857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f8603df2-f68c-42d5-a9c9-48e44249d02f Jul 09 10:03:42 devstack sudo[92857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:42 devstack sudo[92852]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-885917db-0a44-4ac3-9cd5-2118814a1aab req-5617e2fa-a76d-441f-9211-041dad5bff57 tempest-AttachVolumeTestJSON-1815239661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-948225f6-9da0-4dbd-9888-9548426f85fe" returned: 0 in 0.845s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-885917db-0a44-4ac3-9cd5-2118814a1aab req-5617e2fa-a76d-441f-9211-041dad5bff57 tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.875s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-885917db-0a44-4ac3-9cd5-2118814a1aab req-5617e2fa-a76d-441f-9211-041dad5bff57 tempest-AttachVolumeTestJSON-1815239661 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-948225f6-9da0-4dbd-9888-9548426f85fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0426c8db-a789-41ea-8a9f-52158de78b3b', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:03:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-885917db-0a44-4ac3-9cd5-2118814a1aab req-5617e2fa-a76d-441f-9211-041dad5bff57 tempest-AttachVolumeTestJSON-1815239661 None] attachment_update completed successfully. Jul 09 10:03:42 devstack sudo[92857]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5d6f4d00-7686-4ccf-b0b4-bd868632e22f tempest-VolumesCloneNegativeTest-104555850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f8603df2-f68c-42d5-a9c9-48e44249d02f" returned: 0 in 0.783s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5d6f4d00-7686-4ccf-b0b4-bd868632e22f tempest-VolumesCloneNegativeTest-104555850 None] Lock "cinder-quobyte-f8603df2-f68c-42d5-a9c9-48e44249d02f" released by "delete_volume" :: held 1.941s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-5d6f4d00-7686-4ccf-b0b4-bd868632e22f tempest-VolumesCloneNegativeTest-104555850 None] Created reservations ['6cc272f0-1ea8-4ed3-b8e4-d334e664ee7e', 'f382e5a1-29dd-4bb9-a0a7-c476832374b8', 'adc42731-d5d5-47c4-9987-124d1e18cd96', 'a819ead3-be83-41de-856c-262ff2f3d46e'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5d6f4d00-7686-4ccf-b0b4-bd868632e22f tempest-VolumesCloneNegativeTest-104555850 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5d6f4d00-7686-4ccf-b0b4-bd868632e22f tempest-VolumesCloneNegativeTest-104555850 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f4d00-7686-4ccf-b0b4-bd868632e22f tempest-VolumesCloneNegativeTest-104555850 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5d6f4d00-7686-4ccf-b0b4-bd868632e22f tempest-VolumesCloneNegativeTest-104555850 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5d6f4d00-7686-4ccf-b0b4-bd868632e22f tempest-VolumesCloneNegativeTest-104555850 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5d6f4d00-7686-4ccf-b0b4-bd868632e22f tempest-VolumesCloneNegativeTest-104555850 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:43 devstack sudo[92908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:03:43 devstack sudo[92908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Flow 'volume_create_manager' (a0189980-849f-45b2-af8d-9730688a05e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a902171-1e98-412d-b3a2-7451c022bb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a902171-1e98-412d-b3a2-7451c022bb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-528668755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a15b18c-c4a6-4c54-9226-80ec4f56e06c,host='devstack@QuobyteHD#QuobyteHD',id=91fd947d-2b17-431a-9486-af76952d0e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61dd9b7eeda34863a3e4d6ea3aebf31b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:43Z,use_quota=True,user_id='67d9115aefc04410bc16e17cc27f4fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14f3f48c-46fd-4576-826c-967f0c1b56af),volume_type_id=14f3f48c-46fd-4576-826c-967f0c1b56af)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b20f603-055c-4c41-b55b-f745e9f51d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b20f603-055c-4c41-b55b-f745e9f51d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4025afdb-2001-4e8a-bed4-2b4afddcf541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4025afdb-2001-4e8a-bed4-2b4afddcf541) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91fd947d-2b17-431a-9486-af76952d0e51', 'volume_name': 'volume-91fd947d-2b17-431a-9486-af76952d0e51', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a770d93-758e-4f06-960b-14770a5d56f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a770d93-758e-4f06-960b-14770a5d56f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75deb2b-1ec3-46d1-8c20-a97fa0b45e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:43 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Volume 91fd947d-2b17-431a-9486-af76952d0e51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91fd947d-2b17-431a-9486-af76952d0e51', 'volume_size': 1} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0a15b18c-c4a6-4c54-9226-80ec4f56e06c,created_at=2026-07-09T08:03:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-528668755',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a15b18c-c4a6-4c54-9226-80ec4f56e06c,host='devstack@QuobyteHD#QuobyteHD',id=91fd947d-2b17-431a-9486-af76952d0e51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61dd9b7eeda34863a3e4d6ea3aebf31b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:43Z,use_quota=True,user_id='67d9115aefc04410bc16e17cc27f4fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(14f3f48c-46fd-4576-826c-967f0c1b56af),volume_type_id=14f3f48c-46fd-4576-826c-967f0c1b56af)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Creating volume 91fd947d-2b17-431a-9486-af76952d0e51 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:03:43 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:03:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:43 devstack sudo[92933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51 1073741824 Jul 09 10:03:43 devstack sudo[92933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:44 devstack sudo[92908]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5d6f4d00-7686-4ccf-b0b4-bd868632e22f tempest-VolumesCloneNegativeTest-104555850 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.184s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:44 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-5d6f4d00-7686-4ccf-b0b4-bd868632e22f tempest-VolumesCloneNegativeTest-104555850 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:03:44 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5d6f4d00-7686-4ccf-b0b4-bd868632e22f tempest-VolumesCloneNegativeTest-104555850 None] Deleted volume successfully. Jul 09 10:03:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5d6f4d00-7686-4ccf-b0b4-bd868632e22f tempest-VolumesCloneNegativeTest-104555850 None] Lock "cinder-f8603df2-f68c-42d5-a9c9-48e44249d02f-delete_volume" released by "delete_volume" :: held 3.501s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:03:44 devstack sudo[92933]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51 1073741824" returned: 0 in 1.119s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:44 devstack sudo[93255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51 Jul 09 10:03:44 devstack sudo[93255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:45 devstack sudo[93255]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51" returned: 0 in 0.756s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] <== create_volume: return (1936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:03:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.940s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f75deb2b-1ec3-46d1-8c20-a97fa0b45e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91fd947d-2b17-431a-9486-af76952d0e51', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99960d9c-fdb5-466d-8a12-b76ec779d262) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:45 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Volume volume-91fd947d-2b17-431a-9486-af76952d0e51 (91fd947d-2b17-431a-9486-af76952d0e51): created successfully Jul 09 10:03:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99960d9c-fdb5-466d-8a12-b76ec779d262) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Flow 'volume_create_manager' (a0189980-849f-45b2-af8d-9730688a05e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:45 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4b223acb-fae8-4ec0-b5fa-28e437456f69 tempest-GroupSnapshotsTest-1578681694 None] Created volume successfully. Jul 09 10:03:46 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c4b9c457-8090-4f4a-818e-c532bc8d5728 tempest-GroupSnapshotsTest-1578681694 None] Update group completed successfully. Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Flow 'volume_create_manager' (fd04cf57-4d4d-484a-a4d6-1d28d61703df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36fb9e75-7ea3-4711-9cd0-988bdebd5b00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36fb9e75-7ea3-4711-9cd0-988bdebd5b00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1176083214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d4e8c67a26074cb7adce8781f9ec8ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:47Z,use_quota=True,user_id='16d4e9791c944677a6a4b01e6a823cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa5f29b7-e742-4efc-80d0-574799c9c5c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aa5f29b7-e742-4efc-80d0-574799c9c5c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad7cf50-3013-4ce3-80c3-b62f27f9f3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ad7cf50-3013-4ce3-80c3-b62f27f9f3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d', 'volume_name': 'volume-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7c2ce0-3efb-41cf-a9da-445f42db55a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb7c2ce0-3efb-41cf-a9da-445f42db55a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1674162-7d38-48e1-8fad-ec8705aed6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:47 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Volume ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d', 'volume_size': 1} Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:03:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1176083214',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d4e8c67a26074cb7adce8781f9ec8ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:47Z,use_quota=True,user_id='16d4e9791c944677a6a4b01e6a823cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Creating volume ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:03:47 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:03:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:47 devstack sudo[93258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d 1073741824 Jul 09 10:03:47 devstack sudo[93258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-35d6cf64-140b-4645-9fbe-7604a94293e2 tempest-GroupSnapshotsTest-1578681694 None] Update group completed successfully. Jul 09 10:03:48 devstack sudo[93258]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d 1073741824" returned: 0 in 1.063s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:48 devstack sudo[93265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d Jul 09 10:03:48 devstack sudo[93265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:48 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-357974b7-3fe1-443c-9002-6e7b08873a05 tempest-GroupSnapshotsTest-1578681694 None] Update group completed successfully. Jul 09 10:03:48 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:03:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Flow 'volume_create_manager' (4aaabbf4-5975-425d-ac57-b0ce05e38e68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c929e60-44e7-463b-941e-a45e3a76b07e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c929e60-44e7-463b-941e-a45e3a76b07e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1062071006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9267c08f-9419-49d1-8cc2-c05bd36049b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6535348d09554b1baacdd0035a971a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:49Z,use_quota=True,user_id='81895a280ee24d5e81ba3dc5ed0a3f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63d1c14-ada8-45d6-aed8-92940d9b1063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d63d1c14-ada8-45d6-aed8-92940d9b1063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34e766c-90de-455c-8238-c8f1dcf7f000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f34e766c-90de-455c-8238-c8f1dcf7f000) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9267c08f-9419-49d1-8cc2-c05bd36049b7', 'volume_name': 'volume-9267c08f-9419-49d1-8cc2-c05bd36049b7', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabc64d8-ffac-47a0-a3c7-c6790082d1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fabc64d8-ffac-47a0-a3c7-c6790082d1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057f453b-a526-4b3a-bfe5-a3f3f129caee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:48 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Volume 9267c08f-9419-49d1-8cc2-c05bd36049b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9267c08f-9419-49d1-8cc2-c05bd36049b7', 'volume_size': 1} Jul 09 10:03:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:49 devstack sudo[93265]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d" returned: 0 in 0.729s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] <== create_volume: return (1848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:03:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.851s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.350s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:03:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1062071006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9267c08f-9419-49d1-8cc2-c05bd36049b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6535348d09554b1baacdd0035a971a8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:49Z,use_quota=True,user_id='81895a280ee24d5e81ba3dc5ed0a3f7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:03:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Creating volume 9267c08f-9419-49d1-8cc2-c05bd36049b7 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:03:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:03:49 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:03:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9267c08f-9419-49d1-8cc2-c05bd36049b7 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1674162-7d38-48e1-8fad-ec8705aed6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:49 devstack sudo[93269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9267c08f-9419-49d1-8cc2-c05bd36049b7 1073741824 Jul 09 10:03:49 devstack sudo[93269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adcf9911-60d6-4102-a33f-4d1a4217f92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:49 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Volume volume-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d (ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d): created successfully Jul 09 10:03:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (adcf9911-60d6-4102-a33f-4d1a4217f92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Flow 'volume_create_manager' (fd04cf57-4d4d-484a-a4d6-1d28d61703df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:49 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7dfa3bbd-0009-481b-a606-d7dd9a6fc528 tempest-VolumesGetTest-104595405 None] Created volume successfully. Jul 09 10:03:49 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-46913024-3526-4539-a046-dfe0a733caa1 tempest-GroupSnapshotsTest-1578681694 None] Update group completed successfully. Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:03:50 devstack sudo[93269]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Flow 'volume_create_manager' (c8faa991-799d-4f8e-80f6-360d2ac52297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7a9982-1776-41a6-ba2b-e4378e041c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9267c08f-9419-49d1-8cc2-c05bd36049b7 1073741824" returned: 0 in 1.045s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f7a9982-1776-41a6-ba2b-e4378e041c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:03:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-170393032',display_name='tempest-VolumesGetTest-Volume-428951097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d61ec557-d26c-409d-9eca-2ddc50a35fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e8c67a26074cb7adce8781f9ec8ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:50Z,use_quota=True,user_id='16d4e9791c944677a6a4b01e6a823cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d156df-7928-4a51-86f0-293b6f7be1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3d156df-7928-4a51-86f0-293b6f7be1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488ad32a-e18e-4070-ae46-1bd6a5466d22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (488ad32a-e18e-4070-ae46-1bd6a5466d22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd61ec557-d26c-409d-9eca-2ddc50a35fe8', 'volume_name': 'volume-d61ec557-d26c-409d-9eca-2ddc50a35fe8', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9a6cd5-d7fd-4360-86d6-1491280af080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa9a6cd5-d7fd-4360-86d6-1491280af080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fe916c-a1dd-4ded-9eb6-3f5dda9a17df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:50 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Volume d61ec557-d26c-409d-9eca-2ddc50a35fe8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d61ec557-d26c-409d-9eca-2ddc50a35fe8', 'volume_size': 1} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9267c08f-9419-49d1-8cc2-c05bd36049b7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:50 devstack sudo[93275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9267c08f-9419-49d1-8cc2-c05bd36049b7 Jul 09 10:03:50 devstack sudo[93275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:50 devstack sudo[93275]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9267c08f-9419-49d1-8cc2-c05bd36049b7" returned: 0 in 0.674s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] <== create_volume: return (1799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.708s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:03:50Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-170393032',display_name='tempest-VolumesGetTest-Volume-428951097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d61ec557-d26c-409d-9eca-2ddc50a35fe8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e8c67a26074cb7adce8781f9ec8ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:50Z,use_quota=True,user_id='16d4e9791c944677a6a4b01e6a823cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Creating volume d61ec557-d26c-409d-9eca-2ddc50a35fe8 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:03:50 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d61ec557-d26c-409d-9eca-2ddc50a35fe8 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:50 devstack sudo[93278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d61ec557-d26c-409d-9eca-2ddc50a35fe8 1073741824 Jul 09 10:03:50 devstack sudo[93278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (057f453b-a526-4b3a-bfe5-a3f3f129caee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9267c08f-9419-49d1-8cc2-c05bd36049b7', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d9e280-86eb-4395-b08d-df00f590e167) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:50 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Volume volume-9267c08f-9419-49d1-8cc2-c05bd36049b7 (9267c08f-9419-49d1-8cc2-c05bd36049b7): created successfully Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (63d9e280-86eb-4395-b08d-df00f590e167) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Flow 'volume_create_manager' (4aaabbf4-5975-425d-ac57-b0ce05e38e68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2b0cc386-b6ae-46b1-bb3b-d1eb8145274c tempest-AttachVolumeTestJSON-1815239661 None] Created volume successfully. Jul 09 10:03:51 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] GroupSnapshot 3b3bdf07-485e-4ab1-b911-40f0ad69598b: creating. Jul 09 10:03:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Group snapshot 3b3bdf07-485e-4ab1-b911-40f0ad69598b: creating. {{(pid=87192) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 10:03:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:51 devstack sudo[93278]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d61ec557-d26c-409d-9eca-2ddc50a35fe8 1073741824" returned: 0 in 0.962s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d61ec557-d26c-409d-9eca-2ddc50a35fe8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:51 devstack sudo[93287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d61ec557-d26c-409d-9eca-2ddc50a35fe8 Jul 09 10:03:51 devstack sudo[93287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:52 devstack sudo[93287]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d61ec557-d26c-409d-9eca-2ddc50a35fe8" returned: 0 in 0.757s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] <== create_volume: return (1764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:03:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.193s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Creating offline snapshot 43a99e82-74dc-45f9-87a0-ad730df009b1 of volume 91fd947d-2b17-431a-9486-af76952d0e51 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:03:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fe916c-a1dd-4ded-9eb6-3f5dda9a17df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d61ec557-d26c-409d-9eca-2ddc50a35fe8', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f5fbd6-216d-4649-b499-452f733c5d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:52 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0db768a-4799-4131-8b7b-57fd0b9b702f]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:03:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:52 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Volume volume-d61ec557-d26c-409d-9eca-2ddc50a35fe8 (d61ec557-d26c-409d-9eca-2ddc50a35fe8): created successfully Jul 09 10:03:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45f5fbd6-216d-4649-b499-452f733c5d2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Flow 'volume_create_manager' (c8faa991-799d-4f8e-80f6-360d2ac52297) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:52 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0757d17b-12c9-43a4-86d2-c6c9957993d1 tempest-VolumesGetTest-104595405 None] Created volume successfully. Jul 09 10:03:52 devstack sudo[93295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51 Jul 09 10:03:52 devstack sudo[93295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:53 devstack sudo[93295]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51" returned: 0 in 0.861s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.43a99e82-74dc-45f9-87a0-ad730df009b1 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:53 devstack sudo[93302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.43a99e82-74dc-45f9-87a0-ad730df009b1 1G Jul 09 10:03:53 devstack sudo[93302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eee6661b-4286-4722-b72b-fd0e40af4660 tempest-VolumesGetTest-104595405 None] Acquiring lock "cinder-d61ec557-d26c-409d-9eca-2ddc50a35fe8-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:03:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eee6661b-4286-4722-b72b-fd0e40af4660 tempest-VolumesGetTest-104595405 None] Lock "cinder-d61ec557-d26c-409d-9eca-2ddc50a35fe8-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:03:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eee6661b-4286-4722-b72b-fd0e40af4660 tempest-VolumesGetTest-104595405 None] Acquiring lock "cinder-quobyte-d61ec557-d26c-409d-9eca-2ddc50a35fe8" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:03:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eee6661b-4286-4722-b72b-fd0e40af4660 tempest-VolumesGetTest-104595405 None] Lock "cinder-quobyte-d61ec557-d26c-409d-9eca-2ddc50a35fe8" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:03:53 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[023e6a70-1285-43e0-8b97-8765485b1ead]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:03:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eee6661b-4286-4722-b72b-fd0e40af4660 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d61ec557-d26c-409d-9eca-2ddc50a35fe8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:53 devstack sudo[93304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d61ec557-d26c-409d-9eca-2ddc50a35fe8 Jul 09 10:03:53 devstack sudo[93304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:54 devstack sudo[93302]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.43a99e82-74dc-45f9-87a0-ad730df009b1 1G" returned: 0 in 0.886s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91fd947d-2b17-431a-9486-af76952d0e51 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.43a99e82-74dc-45f9-87a0-ad730df009b1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:54 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91fd947d-2b17-431a-9486-af76952d0e51 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.43a99e82-74dc-45f9-87a0-ad730df009b1 Jul 09 10:03:54 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:54 devstack sudo[93304]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eee6661b-4286-4722-b72b-fd0e40af4660 tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d61ec557-d26c-409d-9eca-2ddc50a35fe8" returned: 0 in 0.891s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eee6661b-4286-4722-b72b-fd0e40af4660 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d61ec557-d26c-409d-9eca-2ddc50a35fe8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:54 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d61ec557-d26c-409d-9eca-2ddc50a35fe8 Jul 09 10:03:54 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-92a5f60f-4033-4e0e-9782-1d5b4e1690bc req-eee8e999-9042-45d3-9bb6-02975b4141ac tempest-AttachVolumeTestJSON-1815239661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:55 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-91fd947d-2b17-431a-9486-af76952d0e51 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.43a99e82-74dc-45f9-87a0-ad730df009b1" returned: 0 in 0.712s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:55 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.43a99e82-74dc-45f9-87a0-ad730df009b1 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 10:03:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.43a99e82-74dc-45f9-87a0-ad730df009b1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:55 devstack sudo[93329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.43a99e82-74dc-45f9-87a0-ad730df009b1 Jul 09 10:03:55 devstack sudo[93329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:55 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eee6661b-4286-4722-b72b-fd0e40af4660 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d61ec557-d26c-409d-9eca-2ddc50a35fe8" returned: 0 in 0.686s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eee6661b-4286-4722-b72b-fd0e40af4660 tempest-VolumesGetTest-104595405 None] Lock "cinder-quobyte-d61ec557-d26c-409d-9eca-2ddc50a35fe8" released by "delete_volume" :: held 1.621s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:03:55 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-eee6661b-4286-4722-b72b-fd0e40af4660 tempest-VolumesGetTest-104595405 None] Created reservations ['c4d85111-892e-4764-989d-45054e53ba92', '20219681-0828-4827-b696-80cca70bef32', '556cb71c-164f-4292-97d3-c57e78a899b7', '7fc4a04d-33cc-4392-9208-3a10cb1ac9b1'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:03:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eee6661b-4286-4722-b72b-fd0e40af4660 tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eee6661b-4286-4722-b72b-fd0e40af4660 tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eee6661b-4286-4722-b72b-fd0e40af4660 tempest-VolumesGetTest-104595405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-eee6661b-4286-4722-b72b-fd0e40af4660 tempest-VolumesGetTest-104595405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eee6661b-4286-4722-b72b-fd0e40af4660 tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eee6661b-4286-4722-b72b-fd0e40af4660 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:55 devstack sudo[93332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:03:55 devstack sudo[93332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:55 devstack sudo[93329]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.43a99e82-74dc-45f9-87a0-ad730df009b1" returned: 0 in 0.639s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:55 devstack sudo[93335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.info Jul 09 10:03:55 devstack sudo[93335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4c17bc7f-ea2e-48a6-a490-d48009ddbccb tempest-VolumesGetTest-104595405 None] Acquiring lock "cinder-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:03:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4c17bc7f-ea2e-48a6-a490-d48009ddbccb tempest-VolumesGetTest-104595405 None] Lock "cinder-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:03:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4c17bc7f-ea2e-48a6-a490-d48009ddbccb tempest-VolumesGetTest-104595405 None] Acquiring lock "cinder-quobyte-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:03:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4c17bc7f-ea2e-48a6-a490-d48009ddbccb tempest-VolumesGetTest-104595405 None] Lock "cinder-quobyte-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:03:56 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceb16d57-7db0-42fd-a2ee-ceb9d7cc099a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:03:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4c17bc7f-ea2e-48a6-a490-d48009ddbccb tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:56 devstack sudo[93338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d Jul 09 10:03:56 devstack sudo[93338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:56 devstack sudo[93332]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eee6661b-4286-4722-b72b-fd0e40af4660 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.744s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:56 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-eee6661b-4286-4722-b72b-fd0e40af4660 tempest-VolumesGetTest-104595405 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:03:56 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-eee6661b-4286-4722-b72b-fd0e40af4660 tempest-VolumesGetTest-104595405 None] Deleted volume successfully. Jul 09 10:03:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eee6661b-4286-4722-b72b-fd0e40af4660 tempest-VolumesGetTest-104595405 None] Lock "cinder-d61ec557-d26c-409d-9eca-2ddc50a35fe8-delete_volume" released by "delete_volume" :: held 2.618s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:03:56 devstack sudo[93335]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.info" returned: 0 in 0.639s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:56 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 10:03:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:56 devstack sudo[93341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.info Jul 09 10:03:56 devstack sudo[93341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:56 devstack sudo[93338]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4c17bc7f-ea2e-48a6-a490-d48009ddbccb tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d" returned: 0 in 0.821s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4c17bc7f-ea2e-48a6-a490-d48009ddbccb tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:56 devstack sudo[93346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d Jul 09 10:03:56 devstack sudo[93346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:57 devstack sudo[93341]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.info" returned: 0 in 0.660s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.496s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Creating offline snapshot c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0 of volume 89962e82-57fe-4619-84c8-5712a69a60b7 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:03:57 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9ce860-c7b8-4063-87ce-e7a8f6a6034c]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:03:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:57 devstack sudo[93349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7 Jul 09 10:03:57 devstack sudo[93349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:57 devstack sudo[93346]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4c17bc7f-ea2e-48a6-a490-d48009ddbccb tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d" returned: 0 in 0.661s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4c17bc7f-ea2e-48a6-a490-d48009ddbccb tempest-VolumesGetTest-104595405 None] Lock "cinder-quobyte-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d" released by "delete_volume" :: held 1.548s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:03:57 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-4c17bc7f-ea2e-48a6-a490-d48009ddbccb tempest-VolumesGetTest-104595405 None] Created reservations ['0dc09fcb-70da-4246-97c3-8e747e51d940', '9a735188-5002-4e57-b71c-2ff5e9f9891e', 'd6c0843a-8483-45c5-bb48-1ee8a55cc828', 'b662b7c4-32e9-4107-8228-70fc83f26fde'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:03:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4c17bc7f-ea2e-48a6-a490-d48009ddbccb tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4c17bc7f-ea2e-48a6-a490-d48009ddbccb tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:03:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4c17bc7f-ea2e-48a6-a490-d48009ddbccb tempest-VolumesGetTest-104595405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:03:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4c17bc7f-ea2e-48a6-a490-d48009ddbccb tempest-VolumesGetTest-104595405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:03:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4c17bc7f-ea2e-48a6-a490-d48009ddbccb tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:03:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4c17bc7f-ea2e-48a6-a490-d48009ddbccb tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:57 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:03:57 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:58 devstack sudo[93349]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7" returned: 0 in 0.949s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:58 devstack sudo[93358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0 1G Jul 09 10:03:58 devstack sudo[93358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:03:58 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4c17bc7f-ea2e-48a6-a490-d48009ddbccb tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.977s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:58 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-4c17bc7f-ea2e-48a6-a490-d48009ddbccb tempest-VolumesGetTest-104595405 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:03:58 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4c17bc7f-ea2e-48a6-a490-d48009ddbccb tempest-VolumesGetTest-104595405 None] Deleted volume successfully. Jul 09 10:03:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4c17bc7f-ea2e-48a6-a490-d48009ddbccb tempest-VolumesGetTest-104595405 None] Lock "cinder-ab62f59f-cbc5-496e-a55b-8a37b2dd7e4d-delete_volume" released by "delete_volume" :: held 2.811s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:03:58 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:03:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Flow 'volume_create_manager' (4d7b9f30-1f28-435d-9f8f-77fb0438f00e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:03:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182c24bb-9463-4d56-afcb-c06db0e1f956) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (182c24bb-9463-4d56-afcb-c06db0e1f956) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1991745723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4887f7a5-97dc-4f74-9329-2ebe8552f5d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e8c67a26074cb7adce8781f9ec8ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:59Z,use_quota=True,user_id='16d4e9791c944677a6a4b01e6a823cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c4543d-076c-45ef-b606-4d20929ba548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (45c4543d-076c-45ef-b606-4d20929ba548) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a768d405-6d54-4d08-8ab1-c1d558b3f032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a768d405-6d54-4d08-8ab1-c1d558b3f032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4887f7a5-97dc-4f74-9329-2ebe8552f5d8', 'volume_name': 'volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5774c82-0ef6-4500-bf15-502752d03880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b5774c82-0ef6-4500-bf15-502752d03880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:03:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92efc13-9e83-4a4f-bd1b-9161ba4ea48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:03:58 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Volume 4887f7a5-97dc-4f74-9329-2ebe8552f5d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8', 'volume_size': 1} Jul 09 10:03:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:03:59 devstack sudo[93358]: pam_unix(sudo:session): session closed for user root Jul 09 10:03:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0 1G" returned: 0 in 1.229s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:03:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89962e82-57fe-4619-84c8-5712a69a60b7 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:03:59 devstack sudo[93370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89962e82-57fe-4619-84c8-5712a69a60b7 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0 Jul 09 10:03:59 devstack sudo[93370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:00 devstack sudo[93370]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-89962e82-57fe-4619-84c8-5712a69a60b7 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0" returned: 0 in 0.700s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:00 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 10:04:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:00 devstack sudo[93387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0 Jul 09 10:04:00 devstack sudo[93387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:00 devstack sudo[93387]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0" returned: 0 in 0.635s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:00 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.info Jul 09 10:04:00 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:01 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.info" returned: 0 in 0.651s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:01 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 10:04:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:01 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.info Jul 09 10:04:01 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:02 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.info" returned: 0 in 0.657s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.931s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-92a5f60f-4033-4e0e-9782-1d5b4e1690bc req-eee8e999-9042-45d3-9bb6-02975b4141ac tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 7.106s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7964894e-b130-4cab-84a1-50a5619c560a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-92a5f60f-4033-4e0e-9782-1d5b4e1690bc req-eee8e999-9042-45d3-9bb6-02975b4141ac tempest-AttachVolumeTestJSON-1815239661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9267c08f-9419-49d1-8cc2-c05bd36049b7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2b50d908-3460-49eb-bec7-ffb00f4bb11a tempest-GroupSnapshotsTest-1578681694 None] group_snapshot 3b3bdf07-485e-4ab1-b911-40f0ad69598b: created successfully Jul 09 10:04:02 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9267c08f-9419-49d1-8cc2-c05bd36049b7 Jul 09 10:04:02 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:02 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-92a5f60f-4033-4e0e-9782-1d5b4e1690bc req-eee8e999-9042-45d3-9bb6-02975b4141ac tempest-AttachVolumeTestJSON-1815239661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9267c08f-9419-49d1-8cc2-c05bd36049b7" returned: 0 in 0.910s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-92a5f60f-4033-4e0e-9782-1d5b4e1690bc req-eee8e999-9042-45d3-9bb6-02975b4141ac tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.929s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.128s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:03:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1991745723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4887f7a5-97dc-4f74-9329-2ebe8552f5d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e8c67a26074cb7adce8781f9ec8ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:03:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:03:59Z,use_quota=True,user_id='16d4e9791c944677a6a4b01e6a823cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:04:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Creating volume 4887f7a5-97dc-4f74-9329-2ebe8552f5d8 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:04:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:04:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:04:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:04:02 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:04:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:03 devstack sudo[93432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 1073741824 Jul 09 10:04:03 devstack sudo[93432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-92a5f60f-4033-4e0e-9782-1d5b4e1690bc req-eee8e999-9042-45d3-9bb6-02975b4141ac tempest-AttachVolumeTestJSON-1815239661 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-9267c08f-9419-49d1-8cc2-c05bd36049b7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '314a249a-5924-4c65-94eb-5dffb5187a39', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:04:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-92a5f60f-4033-4e0e-9782-1d5b4e1690bc req-eee8e999-9042-45d3-9bb6-02975b4141ac tempest-AttachVolumeTestJSON-1815239661 None] attachment_update completed successfully. Jul 09 10:04:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] group_snapshot 3b3bdf07-485e-4ab1-b911-40f0ad69598b: deleting Jul 09 10:04:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] group_snapshot 3b3bdf07-485e-4ab1-b911-40f0ad69598b: deleting {{(pid=87192) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 10:04:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "cinder-quobyte-91fd947d-2b17-431a-9486-af76952d0e51" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-91fd947d-2b17-431a-9486-af76952d0e51" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "cinder-quobyte-43a99e82-74dc-45f9-87a0-ad730df009b1" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-43a99e82-74dc-45f9-87a0-ad730df009b1" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Deleting offline snapshot 43a99e82-74dc-45f9-87a0-ad730df009b1 of volume 91fd947d-2b17-431a-9486-af76952d0e51 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:04:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] snapshot_file for this snap is: volume-91fd947d-2b17-431a-9486-af76952d0e51.43a99e82-74dc-45f9-87a0-ad730df009b1 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:04:03 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[17fbd2e2-e120-4817-8d51-298835861b63]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.43a99e82-74dc-45f9-87a0-ad730df009b1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:03 devstack sudo[93472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.43a99e82-74dc-45f9-87a0-ad730df009b1 Jul 09 10:04:03 devstack sudo[93472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:04 devstack sudo[93432]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 1073741824" returned: 0 in 1.262s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:04 devstack sudo[93483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 Jul 09 10:04:04 devstack sudo[93483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:04 devstack sudo[93472]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.43a99e82-74dc-45f9-87a0-ad730df009b1" returned: 0 in 0.868s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-91fd947d-2b17-431a-9486-af76952d0e51(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:04:04 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e9f6a85-7474-4e00-8aae-37ccde37b40c]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:04 devstack sudo[93506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51 Jul 09 10:04:04 devstack sudo[93506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:05 devstack sudo[93483]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8" returned: 0 in 0.775s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] <== create_volume: return (2099ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:04:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.103s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b92efc13-9e83-4a4f-bd1b-9161ba4ea48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5336713f-4d7a-4bae-b503-7eba4414002b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:05 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Volume volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 (4887f7a5-97dc-4f74-9329-2ebe8552f5d8): created successfully Jul 09 10:04:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5336713f-4d7a-4bae-b503-7eba4414002b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Flow 'volume_create_manager' (4d7b9f30-1f28-435d-9f8f-77fb0438f00e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:04:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-90ad0e52-9b76-4afe-b788-8fbbc3591a38 tempest-VolumesGetTest-104595405 None] Created volume successfully. Jul 09 10:04:05 devstack sudo[93506]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51" returned: 0 in 0.882s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.43a99e82-74dc-45f9-87a0-ad730df009b1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:05 devstack sudo[93516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.43a99e82-74dc-45f9-87a0-ad730df009b1 Jul 09 10:04:05 devstack sudo[93516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:06 devstack sudo[93516]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.43a99e82-74dc-45f9-87a0-ad730df009b1" returned: 0 in 0.862s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.43a99e82-74dc-45f9-87a0-ad730df009b1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:06 devstack sudo[93523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.43a99e82-74dc-45f9-87a0-ad730df009b1 Jul 09 10:04:06 devstack sudo[93523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:06 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:04:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Flow 'volume_create_manager' (93ddd872-9a59-4d45-8f51-2a340588b456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:04:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a002a0b6-03b8-4c81-8dd6-8c575599ce9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a002a0b6-03b8-4c81-8dd6-8c575599ce9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:04:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-945683448',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6515ff29-49c5-437e-9786-038ed8b5289b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d4e8c67a26074cb7adce8781f9ec8ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:04:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=4887f7a5-97dc-4f74-9329-2ebe8552f5d8,status='creating',terminated_at=None,updated_at=2026-07-09T08:04:07Z,use_quota=True,user_id='16d4e9791c944677a6a4b01e6a823cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f7417a-d023-4411-81b7-5c25715b1f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22f7417a-d023-4411-81b7-5c25715b1f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4738c3d4-cace-494f-bb25-820fa2aebf1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4738c3d4-cace-494f-bb25-820fa2aebf1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '6515ff29-49c5-437e-9786-038ed8b5289b', 'volume_name': 'volume-6515ff29-49c5-437e-9786-038ed8b5289b', 'volume_size': 1, 'source_volid': '4887f7a5-97dc-4f74-9329-2ebe8552f5d8', 'source_volstatus': 'available'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27cf7545-ac71-44da-a1d7-f32a605bb605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27cf7545-ac71-44da-a1d7-f32a605bb605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d99007f-1326-436d-8bc4-e1e8e1c59daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:07 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Volume 6515ff29-49c5-437e-9786-038ed8b5289b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-6515ff29-49c5-437e-9786-038ed8b5289b', 'volume_size': 1, 'source_volid': '4887f7a5-97dc-4f74-9329-2ebe8552f5d8', 'source_volstatus': 'available'} Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:07 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Cloning volume 4887f7a5-97dc-4f74-9329-2ebe8552f5d8 to volume 6515ff29-49c5-437e-9786-038ed8b5289b Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Creating offline snapshot 755ee282-d991-441c-94a4-e622a0e02201 of volume 4887f7a5-97dc-4f74-9329-2ebe8552f5d8 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[37c621a5-451e-49a7-8082-9687bce87668]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:07 devstack sudo[93523]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51.43a99e82-74dc-45f9-87a0-ad730df009b1" returned: 0 in 0.900s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-43a99e82-74dc-45f9-87a0-ad730df009b1" released by "_delete_snapshot" :: held 3.692s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-91fd947d-2b17-431a-9486-af76952d0e51" released by "delete_snapshot" :: held 3.723s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:07 devstack sudo[93526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 Jul 09 10:04:07 devstack sudo[93526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "cinder-quobyte-89962e82-57fe-4619-84c8-5712a69a60b7" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-89962e82-57fe-4619-84c8-5712a69a60b7" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "cinder-quobyte-c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Deleting offline snapshot c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0 of volume 89962e82-57fe-4619-84c8-5712a69a60b7 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] snapshot_file for this snap is: volume-89962e82-57fe-4619-84c8-5712a69a60b7.c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a5d955d-fbeb-46f8-b524-8287f35a3b4b]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:07 devstack sudo[93528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0 Jul 09 10:04:07 devstack sudo[93528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:08 devstack sudo[93526]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8" returned: 0 in 1.161s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:08 devstack sudo[93536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201 1G Jul 09 10:04:08 devstack sudo[93536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:08 devstack sudo[93528]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0" returned: 0 in 1.313s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-89962e82-57fe-4619-84c8-5712a69a60b7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:04:08 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dadbe22-bac0-4316-b1d3-7f297b34d7ca]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:08 devstack sudo[93542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7 Jul 09 10:04:08 devstack sudo[93542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:09 devstack sudo[93536]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201 1G" returned: 0 in 1.012s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:09 devstack sudo[93549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201 Jul 09 10:04:09 devstack sudo[93549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:09 devstack sudo[93542]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7" returned: 0 in 1.110s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:09 devstack sudo[93556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0 Jul 09 10:04:09 devstack sudo[93556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:09 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-2de4b19f-6138-44a1-b274-301295970365 req-78dfece0-eefe-4d3a-86e5-90f8a8923e46 tempest-AttachVolumeTestJSON-1815239661 None] Terminate volume connection completed successfully. Jul 09 10:04:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-2de4b19f-6138-44a1-b274-301295970365 req-78dfece0-eefe-4d3a-86e5-90f8a8923e46 tempest-AttachVolumeTestJSON-1815239661 None] Deleting attachment 0426c8db-a789-41ea-8a9f-52158de78b3b. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:04:10 devstack sudo[93549]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201" returned: 0 in 0.980s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:10 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201 is being set with open permissions: ugo+rw Jul 09 10:04:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:10 devstack sudo[93563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201 Jul 09 10:04:10 devstack sudo[93563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:10 devstack sudo[93556]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0" returned: 0 in 0.905s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:10 devstack sudo[93568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0 Jul 09 10:04:10 devstack sudo[93568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:11 devstack sudo[93563]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201" returned: 0 in 0.869s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:11 devstack sudo[93571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.info Jul 09 10:04:11 devstack sudo[93571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:11 devstack sudo[93568]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7.c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0" returned: 0 in 0.886s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-c687c2c4-aa47-41c0-a7a5-8f8bc9773ea0" released by "_delete_snapshot" :: held 4.321s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-89962e82-57fe-4619-84c8-5712a69a60b7" released by "delete_snapshot" :: held 4.348s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:11 devstack cinder-volume[87192]: WARNING cinder.quota [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1637535735 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1637535735, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:04:11 devstack cinder-volume[87192]: WARNING cinder.quota [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1637535735 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1637535735, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:04:11 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Created reservations ['350d3a78-bdf4-4c47-8ead-42a247cf1595', 'f314bbc2-b747-4881-8931-4340eecf2e88', '7877b5a7-1e04-4d2a-93a3-63263e948cbf', 'bfacd0c0-f407-4016-9540-4cc91daf6233'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:04:11 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] Created reservations ['90986830-b36a-4292-85c1-bc45b9e33734', 'd880f47a-488d-4d6b-854f-ab0a4acdc59c', 'ec7540f6-cbc1-49f5-b7c6-c140c2e7f6ab', 'b98bfce5-1eb0-478d-84ce-72934d00dc0f'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:04:11 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-52b9b05d-798d-4624-8637-17362d6bd8ea tempest-GroupSnapshotsTest-1578681694 None] group_snapshot 3b3bdf07-485e-4ab1-b911-40f0ad69598b: deleted successfully Jul 09 10:04:11 devstack sudo[93571]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.info" returned: 0 in 0.778s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:11 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.info is being set with open permissions: ugo+rw Jul 09 10:04:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:12 devstack sudo[93576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.info Jul 09 10:04:12 devstack sudo[93576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:12 devstack sudo[93576]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.info" returned: 0 in 0.770s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Acquiring lock "cinder-quobyte-6515ff29-49c5-437e-9786-038ed8b5289b" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Lock "cinder-quobyte-6515ff29-49c5-437e-9786-038ed8b5289b" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] snapshot: 755ee282-d991-441c-94a4-e622a0e02201, volume: 6515ff29-49c5-437e-9786-038ed8b5289b, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 10:04:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:04:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:04:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:12 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe8dca3-02e3-43d7-a2b8-2e99c89c7844]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:12 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=125,cinder:UPDATE=130,cinder:INSERT=25,cinder:DELETE=7 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:04:12 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-1535c5ae-663f-402b-848e-a58b47e58c38 req-23863948-0821-446b-8288-6b8cee340d53 tempest-AttachVolumeTestJSON-1815239661 None] Terminate volume connection completed successfully. Jul 09 10:04:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-1535c5ae-663f-402b-848e-a58b47e58c38 req-23863948-0821-446b-8288-6b8cee340d53 tempest-AttachVolumeTestJSON-1815239661 None] Deleting attachment 314a249a-5924-4c65-94eb-5dffb5187a39. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:04:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "cinder-quobyte-89962e82-57fe-4619-84c8-5712a69a60b7" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:13 devstack sudo[93582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201 Jul 09 10:04:13 devstack sudo[93582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-89962e82-57fe-4619-84c8-5712a69a60b7" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:13 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e02606f-71b4-4861-8fa6-77751357a611]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:13 devstack sudo[93584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7 Jul 09 10:04:13 devstack sudo[93584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:13 devstack sudo[93582]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201" returned: 0 in 0.921s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:04:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 10:04:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 10:04:13 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[84bdc5a7-a35b-403d-9eca-70bbf53a4bd3]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:13 devstack sudo[93592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 Jul 09 10:04:13 devstack sudo[93592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:13 devstack sudo[93584]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7" returned: 0 in 0.877s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:13 devstack sudo[93594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7 Jul 09 10:04:13 devstack sudo[93594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:14 devstack sudo[93594]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-89962e82-57fe-4619-84c8-5712a69a60b7" returned: 0 in 0.717s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:14 devstack sudo[93592]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-89962e82-57fe-4619-84c8-5712a69a60b7" released by "delete_volume" :: held 1.654s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "cinder-quobyte-91fd947d-2b17-431a-9486-af76952d0e51" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8" returned: 0 in 0.867s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:14 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Path /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6515ff29-49c5-437e-9786-038ed8b5289b not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 10:04:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6515ff29-49c5-437e-9786-038ed8b5289b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-91fd947d-2b17-431a-9486-af76952d0e51" acquired by "delete_volume" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:14 devstack sudo[93602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6515ff29-49c5-437e-9786-038ed8b5289b Jul 09 10:04:14 devstack sudo[93602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:14 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9077f409-adab-4cb8-b742-dd6ae93df29e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:14 devstack sudo[93604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51 Jul 09 10:04:14 devstack sudo[93604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:15 devstack sudo[93604]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51" returned: 0 in 0.863s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:15 devstack sudo[93614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51 Jul 09 10:04:15 devstack sudo[93614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:17 devstack sudo[93614]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-91fd947d-2b17-431a-9486-af76952d0e51" returned: 0 in 2.268s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-91fd947d-2b17-431a-9486-af76952d0e51" released by "delete_volume" :: held 3.216s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:18 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=119,cinder:INSERT=34,cinder:UPDATE=129,cinder:DELETE=8 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:04:18 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Created reservations ['ad0a54b8-1b41-4f59-94b3-8fb5837febb6'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:04:18 devstack cinder-volume[87192]: WARNING cinder.quota [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1637535735 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1637535735, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:04:18 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Created reservations ['101cbd47-52d1-4a2d-878f-762e3adae2fb', '89d52f09-d936-4a67-ab0a-4fd81d7e7d99', '6f7c3079-50c8-43b8-ae93-3725634b8ce3', '638002b9-374c-41a5-a3f5-1c94835af94c'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:04:18 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Created reservations ['5cbaa3ac-594b-471f-b8e6-d2076862d06a', '46bd6758-1d03-48f0-8e1c-f46f0c10922f', 'f26ca405-ae1c-42c1-b6cd-bf7dff6b95b6', 'a6e7dc49-190a-4875-8a7b-7f357e8f152e'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:04:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:04:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:04:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:19 devstack sudo[93660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:04:19 devstack sudo[93660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:20 devstack sudo[93660]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.442s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:20 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:04:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-394d2fda-b672-4e86-8a9f-30e965c0a26b tempest-GroupSnapshotsTest-1578681694 None] Delete group completed successfully. Jul 09 10:04:21 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-33199ad8-a392-42b0-8212-48908f9ad6aa tempest-GroupSnapshotsTest-1578681694 None] Group tempest-GroupSnapshotsTest-Group-398211641: creating Jul 09 10:04:21 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-33199ad8-a392-42b0-8212-48908f9ad6aa tempest-GroupSnapshotsTest-1578681694 None] Group tempest-GroupSnapshotsTest-Group-398211641: created successfully Jul 09 10:04:21 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-33199ad8-a392-42b0-8212-48908f9ad6aa tempest-GroupSnapshotsTest-1578681694 None] Create group completed successfully. Jul 09 10:04:21 devstack sudo[93602]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6515ff29-49c5-437e-9786-038ed8b5289b" returned: 0 in 7.144s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:21 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[01689aa6-75d5-481a-b7b7-79da20ee5db0]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:21 devstack sudo[93667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 Jul 09 10:04:21 devstack sudo[93667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Flow 'volume_create_manager' (bc587018-82f5-441e-bffd-1b4c47a3967f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b56af0-9e1a-4bc1-b103-17cd0f2d1776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09b56af0-9e1a-4bc1-b103-17cd0f2d1776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-569767845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=289b3fc7-53cc-43ae-8a1b-77b0f559f3bc,host='devstack@QuobyteHD#QuobyteHD',id=20f09412-dfc3-4a9a-afea-40871bba0602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61dd9b7eeda34863a3e4d6ea3aebf31b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:04:23Z,use_quota=True,user_id='67d9115aefc04410bc16e17cc27f4fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e46c655c-90ad-4d13-a25e-d464782fb660),volume_type_id=e46c655c-90ad-4d13-a25e-d464782fb660)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6219ae0-0e22-42fe-af21-fd735afdf64e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6219ae0-0e22-42fe-af21-fd735afdf64e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d73cd4b-f8d8-42ff-abba-eb3283832730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d73cd4b-f8d8-42ff-abba-eb3283832730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '20f09412-dfc3-4a9a-afea-40871bba0602', 'volume_name': 'volume-20f09412-dfc3-4a9a-afea-40871bba0602', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e054bd2-d987-485e-a540-60cebd89fbc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e054bd2-d987-485e-a540-60cebd89fbc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bdd3ac1-df7c-409c-b936-faa97b16ca9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:22 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Volume 20f09412-dfc3-4a9a-afea-40871bba0602: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-20f09412-dfc3-4a9a-afea-40871bba0602', 'volume_size': 1} Jul 09 10:04:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:22 devstack sudo[93667]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8" returned: 0 in 1.006s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:22 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Image conversion details: src /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8, size 1024.00 MB, duration 7.14 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6515ff29-49c5-437e-9786-038ed8b5289b {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:04:22 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Converted 1024.00 MB image at 143.32 MB/s Jul 09 10:04:22 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6515ff29-49c5-437e-9786-038ed8b5289b is being set with open permissions: ugo+rw Jul 09 10:04:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6515ff29-49c5-437e-9786-038ed8b5289b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:22 devstack sudo[93673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6515ff29-49c5-437e-9786-038ed8b5289b Jul 09 10:04:22 devstack sudo[93673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:23 devstack sudo[93673]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6515ff29-49c5-437e-9786-038ed8b5289b" returned: 0 in 0.633s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Lock "cinder-quobyte-6515ff29-49c5-437e-9786-038ed8b5289b" released by "_copy_volume_from_snapshot" :: held 10.664s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Acquiring lock "cinder-quobyte-755ee282-d991-441c-94a4-e622a0e02201" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Lock "cinder-quobyte-755ee282-d991-441c-94a4-e622a0e02201" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Deleting offline snapshot 755ee282-d991-441c-94a4-e622a0e02201 of volume 4887f7a5-97dc-4f74-9329-2ebe8552f5d8 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:04:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] snapshot_file for this snap is: volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:04:23 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[84797f11-3986-48e7-9563-e3cedf871d4b]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:23 devstack sudo[93710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201 Jul 09 10:04:23 devstack sudo[93710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:24 devstack sudo[93710]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201" returned: 0 in 0.790s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:04:24 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[213d2681-75cc-4463-9d6d-bc369a3596be]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:24 devstack sudo[93717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 Jul 09 10:04:24 devstack sudo[93717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:25 devstack sudo[93717]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8" returned: 0 in 0.869s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:25 devstack sudo[93722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201 Jul 09 10:04:25 devstack sudo[93722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ab6d0dd1-6333-4c41-ac29-5504d19635d2 tempest-AttachVolumeTestJSON-1815239661 None] Acquiring lock "cinder-9267c08f-9419-49d1-8cc2-c05bd36049b7-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ab6d0dd1-6333-4c41-ac29-5504d19635d2 tempest-AttachVolumeTestJSON-1815239661 None] Lock "cinder-9267c08f-9419-49d1-8cc2-c05bd36049b7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ab6d0dd1-6333-4c41-ac29-5504d19635d2 tempest-AttachVolumeTestJSON-1815239661 None] Acquiring lock "cinder-quobyte-9267c08f-9419-49d1-8cc2-c05bd36049b7" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ab6d0dd1-6333-4c41-ac29-5504d19635d2 tempest-AttachVolumeTestJSON-1815239661 None] Lock "cinder-quobyte-9267c08f-9419-49d1-8cc2-c05bd36049b7" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:25 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6f2d5e7-3220-41eb-b667-b0a1ed3fa2da]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ab6d0dd1-6333-4c41-ac29-5504d19635d2 tempest-AttachVolumeTestJSON-1815239661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9267c08f-9419-49d1-8cc2-c05bd36049b7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:25 devstack sudo[93724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9267c08f-9419-49d1-8cc2-c05bd36049b7 Jul 09 10:04:25 devstack sudo[93724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:26 devstack sudo[93722]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201" returned: 0 in 0.820s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:26 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201 Jul 09 10:04:26 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:26 devstack sudo[93724]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ab6d0dd1-6333-4c41-ac29-5504d19635d2 tempest-AttachVolumeTestJSON-1815239661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9267c08f-9419-49d1-8cc2-c05bd36049b7" returned: 0 in 0.830s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ab6d0dd1-6333-4c41-ac29-5504d19635d2 tempest-AttachVolumeTestJSON-1815239661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9267c08f-9419-49d1-8cc2-c05bd36049b7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:26 devstack sudo[93734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9267c08f-9419-49d1-8cc2-c05bd36049b7 Jul 09 10:04:26 devstack sudo[93734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:26 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8.755ee282-d991-441c-94a4-e622a0e02201" returned: 0 in 0.682s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Lock "cinder-quobyte-755ee282-d991-441c-94a4-e622a0e02201" released by "_delete_snapshot" :: held 3.252s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 19.782s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.017s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=289b3fc7-53cc-43ae-8a1b-77b0f559f3bc,created_at=2026-07-09T08:04:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-569767845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=289b3fc7-53cc-43ae-8a1b-77b0f559f3bc,host='devstack@QuobyteHD#QuobyteHD',id=20f09412-dfc3-4a9a-afea-40871bba0602,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61dd9b7eeda34863a3e4d6ea3aebf31b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:04:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:04:23Z,use_quota=True,user_id='67d9115aefc04410bc16e17cc27f4fb6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e46c655c-90ad-4d13-a25e-d464782fb660),volume_type_id=e46c655c-90ad-4d13-a25e-d464782fb660)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Creating volume 20f09412-dfc3-4a9a-afea-40871bba0602 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:04:26 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:26 devstack sudo[93737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602 1073741824 Jul 09 10:04:26 devstack sudo[93737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d99007f-1326-436d-8bc4-e1e8e1c59daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6515ff29-49c5-437e-9786-038ed8b5289b', 'volume_size': 1, 'source_volid': '4887f7a5-97dc-4f74-9329-2ebe8552f5d8', 'source_volstatus': 'available'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1f8c24-126e-4977-accf-a0365860d1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:26 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Volume volume-6515ff29-49c5-437e-9786-038ed8b5289b (6515ff29-49c5-437e-9786-038ed8b5289b): created successfully Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d1f8c24-126e-4977-accf-a0365860d1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Flow 'volume_create_manager' (93ddd872-9a59-4d45-8f51-2a340588b456) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:04:26 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a7090413-9bb2-4571-974b-a9269718c920 tempest-VolumesGetTest-104595405 None] Created volume successfully. Jul 09 10:04:27 devstack sudo[93734]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ab6d0dd1-6333-4c41-ac29-5504d19635d2 tempest-AttachVolumeTestJSON-1815239661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9267c08f-9419-49d1-8cc2-c05bd36049b7" returned: 0 in 0.699s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ab6d0dd1-6333-4c41-ac29-5504d19635d2 tempest-AttachVolumeTestJSON-1815239661 None] Lock "cinder-quobyte-9267c08f-9419-49d1-8cc2-c05bd36049b7" released by "delete_volume" :: held 1.579s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:27 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ab6d0dd1-6333-4c41-ac29-5504d19635d2 tempest-AttachVolumeTestJSON-1815239661 None] Created reservations ['a935af91-5fa1-4017-b971-ddb9e82eca6f', '532bb886-20ad-4600-b8cd-e492ec49dd94', 'eb0ecc88-4e9d-4ef4-a08c-d9bcb6f96a37', 'aaa5e2c0-95e4-4d7d-98da-84dcd3a9951b'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:04:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ab6d0dd1-6333-4c41-ac29-5504d19635d2 tempest-AttachVolumeTestJSON-1815239661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ab6d0dd1-6333-4c41-ac29-5504d19635d2 tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ab6d0dd1-6333-4c41-ac29-5504d19635d2 tempest-AttachVolumeTestJSON-1815239661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:04:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ab6d0dd1-6333-4c41-ac29-5504d19635d2 tempest-AttachVolumeTestJSON-1815239661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:04:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ab6d0dd1-6333-4c41-ac29-5504d19635d2 tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ab6d0dd1-6333-4c41-ac29-5504d19635d2 tempest-AttachVolumeTestJSON-1815239661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:27 devstack sudo[93740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:04:27 devstack sudo[93740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:27 devstack sudo[93737]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602 1073741824" returned: 0 in 0.905s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dce9e31b-dfbf-4f85-8f4e-36893fecd3b9 tempest-AttachVolumeTestJSON-1815239661 None] Acquiring lock "cinder-948225f6-9da0-4dbd-9888-9548426f85fe-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dce9e31b-dfbf-4f85-8f4e-36893fecd3b9 tempest-AttachVolumeTestJSON-1815239661 None] Lock "cinder-948225f6-9da0-4dbd-9888-9548426f85fe-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:27 devstack sudo[93747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602 Jul 09 10:04:27 devstack sudo[93747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dce9e31b-dfbf-4f85-8f4e-36893fecd3b9 tempest-AttachVolumeTestJSON-1815239661 None] Acquiring lock "cinder-quobyte-948225f6-9da0-4dbd-9888-9548426f85fe" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dce9e31b-dfbf-4f85-8f4e-36893fecd3b9 tempest-AttachVolumeTestJSON-1815239661 None] Lock "cinder-quobyte-948225f6-9da0-4dbd-9888-9548426f85fe" acquired by "delete_volume" :: waited 0.044s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[45fb5f74-c90c-4ab9-bbeb-d8dfbe58d358]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dce9e31b-dfbf-4f85-8f4e-36893fecd3b9 tempest-AttachVolumeTestJSON-1815239661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-948225f6-9da0-4dbd-9888-9548426f85fe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Flow 'volume_create_manager' (cac4f663-126c-4e77-888a-1ee8fd49c60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60dd1997-5c7c-4bd8-8a11-d39eeb3e9adc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:28 devstack sudo[93750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-948225f6-9da0-4dbd-9888-9548426f85fe Jul 09 10:04:28 devstack sudo[93750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60dd1997-5c7c-4bd8-8a11-d39eeb3e9adc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:04:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1573571275',display_name='tempest-VolumesGetTest-Volume-227396983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9444ee6c-4d70-43b8-96c6-12803417225e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e8c67a26074cb7adce8781f9ec8ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:04:28Z,use_quota=True,user_id='16d4e9791c944677a6a4b01e6a823cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f6a5b4-aa14-4580-bf66-0fc401b0f0fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:28 devstack sudo[93740]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12f6a5b4-aa14-4580-bf66-0fc401b0f0fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248fc694-a86d-4f22-a2d3-68044002a5b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (248fc694-a86d-4f22-a2d3-68044002a5b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9444ee6c-4d70-43b8-96c6-12803417225e', 'volume_name': 'volume-9444ee6c-4d70-43b8-96c6-12803417225e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a22fa7-1651-4dd5-83a5-fa2db91c775e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16a22fa7-1651-4dd5-83a5-fa2db91c775e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc45ca9-1380-407a-a41f-f4a9a76a121f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:28 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Volume 9444ee6c-4d70-43b8-96c6-12803417225e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9444ee6c-4d70-43b8-96c6-12803417225e', 'volume_size': 1} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ab6d0dd1-6333-4c41-ac29-5504d19635d2 tempest-AttachVolumeTestJSON-1815239661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.877s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-ab6d0dd1-6333-4c41-ac29-5504d19635d2 tempest-AttachVolumeTestJSON-1815239661 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:04:28 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ab6d0dd1-6333-4c41-ac29-5504d19635d2 tempest-AttachVolumeTestJSON-1815239661 None] Deleted volume successfully. Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ab6d0dd1-6333-4c41-ac29-5504d19635d2 tempest-AttachVolumeTestJSON-1815239661 None] Lock "cinder-9267c08f-9419-49d1-8cc2-c05bd36049b7-delete_volume" released by "delete_volume" :: held 2.669s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:28 devstack sudo[93747]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602" returned: 0 in 0.753s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.744s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.392s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:04:28Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1573571275',display_name='tempest-VolumesGetTest-Volume-227396983',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9444ee6c-4d70-43b8-96c6-12803417225e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e8c67a26074cb7adce8781f9ec8ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:04:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:04:28Z,use_quota=True,user_id='16d4e9791c944677a6a4b01e6a823cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Creating volume 9444ee6c-4d70-43b8-96c6-12803417225e {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:04:28 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9444ee6c-4d70-43b8-96c6-12803417225e 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bdd3ac1-df7c-409c-b936-faa97b16ca9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20f09412-dfc3-4a9a-afea-40871bba0602', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:28 devstack sudo[93754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9444ee6c-4d70-43b8-96c6-12803417225e 1073741824 Jul 09 10:04:28 devstack sudo[93754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0f3ccd-628d-4c6f-8303-de4825d818fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:28 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Volume volume-20f09412-dfc3-4a9a-afea-40871bba0602 (20f09412-dfc3-4a9a-afea-40871bba0602): created successfully Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d0f3ccd-628d-4c6f-8303-de4825d818fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Flow 'volume_create_manager' (bc587018-82f5-441e-bffd-1b4c47a3967f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:04:28 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f9c87f63-21e0-4780-a9a3-4dd99bb17884 tempest-GroupSnapshotsTest-1578681694 None] Created volume successfully. Jul 09 10:04:28 devstack sudo[93750]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dce9e31b-dfbf-4f85-8f4e-36893fecd3b9 tempest-AttachVolumeTestJSON-1815239661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-948225f6-9da0-4dbd-9888-9548426f85fe" returned: 0 in 0.854s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dce9e31b-dfbf-4f85-8f4e-36893fecd3b9 tempest-AttachVolumeTestJSON-1815239661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-948225f6-9da0-4dbd-9888-9548426f85fe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:28 devstack sudo[93759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-948225f6-9da0-4dbd-9888-9548426f85fe Jul 09 10:04:28 devstack sudo[93759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:29 devstack sudo[93754]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9444ee6c-4d70-43b8-96c6-12803417225e 1073741824" returned: 0 in 0.947s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:29 devstack sudo[93759]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dce9e31b-dfbf-4f85-8f4e-36893fecd3b9 tempest-AttachVolumeTestJSON-1815239661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-948225f6-9da0-4dbd-9888-9548426f85fe" returned: 0 in 0.705s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dce9e31b-dfbf-4f85-8f4e-36893fecd3b9 tempest-AttachVolumeTestJSON-1815239661 None] Lock "cinder-quobyte-948225f6-9da0-4dbd-9888-9548426f85fe" released by "delete_volume" :: held 1.618s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9444ee6c-4d70-43b8-96c6-12803417225e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:29 devstack sudo[93769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9444ee6c-4d70-43b8-96c6-12803417225e Jul 09 10:04:29 devstack sudo[93769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:29 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-dce9e31b-dfbf-4f85-8f4e-36893fecd3b9 tempest-AttachVolumeTestJSON-1815239661 None] Created reservations ['0c446e94-2756-435e-ae86-4976cf7ec3cc', '9f97d0df-06a1-4284-940a-e3c89ec60e5b', '004e05c9-93ec-4c54-a789-350219caed4a', '4746a02e-6fbb-49d1-8c24-c38d5587eff5'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:04:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:04:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:04:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:04:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:29 devstack sudo[93774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:04:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dce9e31b-dfbf-4f85-8f4e-36893fecd3b9 tempest-AttachVolumeTestJSON-1815239661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dce9e31b-dfbf-4f85-8f4e-36893fecd3b9 tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dce9e31b-dfbf-4f85-8f4e-36893fecd3b9 tempest-AttachVolumeTestJSON-1815239661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:04:29 devstack sudo[93774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dce9e31b-dfbf-4f85-8f4e-36893fecd3b9 tempest-AttachVolumeTestJSON-1815239661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:04:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dce9e31b-dfbf-4f85-8f4e-36893fecd3b9 tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dce9e31b-dfbf-4f85-8f4e-36893fecd3b9 tempest-AttachVolumeTestJSON-1815239661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:29 devstack sudo[93780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:04:29 devstack sudo[93780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Flow 'volume_create_manager' (4a64df14-d730-4355-ace5-271e47c16af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2549bf50-98d1-42cc-8d6c-3d984e4675ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2549bf50-98d1-42cc-8d6c-3d984e4675ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1126505773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106de322-0fe6-4ef7-b33c-742d7ee30850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbdff29796664c4a9c2670bdafb4798a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:04:30Z,use_quota=True,user_id='7964de238ae9434b810e3241ea5f12c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d59830-8889-492e-8a1b-dbeab780a7ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36d59830-8889-492e-8a1b-dbeab780a7ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef576e8-a65a-4bd0-8f45-136ed46a6447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ef576e8-a65a-4bd0-8f45-136ed46a6447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '106de322-0fe6-4ef7-b33c-742d7ee30850', 'volume_name': 'volume-106de322-0fe6-4ef7-b33c-742d7ee30850', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b0089a-e1a7-4e28-962e-a74950abbd4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49b0089a-e1a7-4e28-962e-a74950abbd4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5136aa-9c1d-4aee-91ad-3886845b85ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:30 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Volume 106de322-0fe6-4ef7-b33c-742d7ee30850: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-106de322-0fe6-4ef7-b33c-742d7ee30850', 'volume_size': 1} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] GroupSnapshot 081ad64b-9cfd-463b-b374-6dd3d7b248df: creating. Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] Group snapshot 081ad64b-9cfd-463b-b374-6dd3d7b248df: creating. {{(pid=87192) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f78787f6-2cba-44b6-b74d-bb36792219f7 tempest-AttachVolumeTestJSON-1815239661 None] Acquiring lock "cinder-25b1de4e-551f-41f6-9c4d-94e5f8244bb7-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f78787f6-2cba-44b6-b74d-bb36792219f7 tempest-AttachVolumeTestJSON-1815239661 None] Lock "cinder-25b1de4e-551f-41f6-9c4d-94e5f8244bb7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f78787f6-2cba-44b6-b74d-bb36792219f7 tempest-AttachVolumeTestJSON-1815239661 None] Acquiring lock "cinder-quobyte-25b1de4e-551f-41f6-9c4d-94e5f8244bb7" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f78787f6-2cba-44b6-b74d-bb36792219f7 tempest-AttachVolumeTestJSON-1815239661 None] Lock "cinder-quobyte-25b1de4e-551f-41f6-9c4d-94e5f8244bb7" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a2de99-452d-4a19-bf12-a0f07865825d]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f78787f6-2cba-44b6-b74d-bb36792219f7 tempest-AttachVolumeTestJSON-1815239661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-25b1de4e-551f-41f6-9c4d-94e5f8244bb7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:30 devstack sudo[93769]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9444ee6c-4d70-43b8-96c6-12803417225e" returned: 0 in 1.263s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] <== create_volume: return (2282ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.285s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.544s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:04:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1126505773',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=106de322-0fe6-4ef7-b33c-742d7ee30850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbdff29796664c4a9c2670bdafb4798a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:04:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:04:30Z,use_quota=True,user_id='7964de238ae9434b810e3241ea5f12c4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Creating volume 106de322-0fe6-4ef7-b33c-742d7ee30850 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:04:30 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-106de322-0fe6-4ef7-b33c-742d7ee30850 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:30 devstack sudo[93782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-25b1de4e-551f-41f6-9c4d-94e5f8244bb7 Jul 09 10:04:30 devstack sudo[93782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:30 devstack sudo[93787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-106de322-0fe6-4ef7-b33c-742d7ee30850 1073741824 Jul 09 10:04:30 devstack sudo[93787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fc45ca9-1380-407a-a41f-f4a9a76a121f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9444ee6c-4d70-43b8-96c6-12803417225e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7e1735-74be-4a26-86ae-9c508086a619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:30 devstack sudo[93774]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.195s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 8 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:04:30 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Volume volume-9444ee6c-4d70-43b8-96c6-12803417225e (9444ee6c-4d70-43b8-96c6-12803417225e): created successfully Jul 09 10:04:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a7e1735-74be-4a26-86ae-9c508086a619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Flow 'volume_create_manager' (cac4f663-126c-4e77-888a-1ee8fd49c60e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:04:31 devstack sudo[93780]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:31 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-698747ed-3652-40ba-8e47-b37829bef9f9 tempest-VolumesGetTest-104595405 None] Created volume successfully. Jul 09 10:04:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dce9e31b-dfbf-4f85-8f4e-36893fecd3b9 tempest-AttachVolumeTestJSON-1815239661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.176s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:31 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-dce9e31b-dfbf-4f85-8f4e-36893fecd3b9 tempest-AttachVolumeTestJSON-1815239661 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:04:31 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-dce9e31b-dfbf-4f85-8f4e-36893fecd3b9 tempest-AttachVolumeTestJSON-1815239661 None] Deleted volume successfully. Jul 09 10:04:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dce9e31b-dfbf-4f85-8f4e-36893fecd3b9 tempest-AttachVolumeTestJSON-1815239661 None] Lock "cinder-948225f6-9da0-4dbd-9888-9548426f85fe-delete_volume" released by "delete_volume" :: held 3.208s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c4cc2a66-2a61-40d3-84d6-9219f2ab50a9 tempest-VolumesGetTest-104595405 None] Acquiring lock "cinder-9444ee6c-4d70-43b8-96c6-12803417225e-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c4cc2a66-2a61-40d3-84d6-9219f2ab50a9 tempest-VolumesGetTest-104595405 None] Lock "cinder-9444ee6c-4d70-43b8-96c6-12803417225e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c4cc2a66-2a61-40d3-84d6-9219f2ab50a9 tempest-VolumesGetTest-104595405 None] Acquiring lock "cinder-quobyte-9444ee6c-4d70-43b8-96c6-12803417225e" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c4cc2a66-2a61-40d3-84d6-9219f2ab50a9 tempest-VolumesGetTest-104595405 None] Lock "cinder-quobyte-9444ee6c-4d70-43b8-96c6-12803417225e" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:31 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[060ba92e-8c98-415f-8263-ad851eb2e400]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c4cc2a66-2a61-40d3-84d6-9219f2ab50a9 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9444ee6c-4d70-43b8-96c6-12803417225e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:31 devstack sudo[93792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9444ee6c-4d70-43b8-96c6-12803417225e Jul 09 10:04:31 devstack sudo[93792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:31 devstack sudo[93782]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f78787f6-2cba-44b6-b74d-bb36792219f7 tempest-AttachVolumeTestJSON-1815239661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-25b1de4e-551f-41f6-9c4d-94e5f8244bb7" returned: 0 in 1.259s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f78787f6-2cba-44b6-b74d-bb36792219f7 tempest-AttachVolumeTestJSON-1815239661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-25b1de4e-551f-41f6-9c4d-94e5f8244bb7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:31 devstack sudo[93797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-25b1de4e-551f-41f6-9c4d-94e5f8244bb7 Jul 09 10:04:31 devstack sudo[93797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:32 devstack sudo[93787]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-106de322-0fe6-4ef7-b33c-742d7ee30850 1073741824" returned: 0 in 1.133s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-106de322-0fe6-4ef7-b33c-742d7ee30850 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:32 devstack sudo[93799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-106de322-0fe6-4ef7-b33c-742d7ee30850 Jul 09 10:04:32 devstack sudo[93799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:32 devstack sudo[93792]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c4cc2a66-2a61-40d3-84d6-9219f2ab50a9 tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9444ee6c-4d70-43b8-96c6-12803417225e" returned: 0 in 0.866s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c4cc2a66-2a61-40d3-84d6-9219f2ab50a9 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9444ee6c-4d70-43b8-96c6-12803417225e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:32 devstack sudo[93805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9444ee6c-4d70-43b8-96c6-12803417225e Jul 09 10:04:32 devstack sudo[93805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:32 devstack sudo[93797]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f78787f6-2cba-44b6-b74d-bb36792219f7 tempest-AttachVolumeTestJSON-1815239661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-25b1de4e-551f-41f6-9c4d-94e5f8244bb7" returned: 0 in 0.795s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f78787f6-2cba-44b6-b74d-bb36792219f7 tempest-AttachVolumeTestJSON-1815239661 None] Lock "cinder-quobyte-25b1de4e-551f-41f6-9c4d-94e5f8244bb7" released by "delete_volume" :: held 2.127s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:32 devstack sudo[93799]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:32 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-f78787f6-2cba-44b6-b74d-bb36792219f7 tempest-AttachVolumeTestJSON-1815239661 None] Created reservations ['ba21b3cf-a1a2-4f3a-964d-7d364f588f28', '8eceb758-aadb-47f5-9624-473f959b31f6', '905be7e8-2786-4b3f-8333-bed1b7748c12', 'cc42e323-1074-4a52-a0ca-9148865766b8'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:04:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-106de322-0fe6-4ef7-b33c-742d7ee30850" returned: 0 in 0.776s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] <== create_volume: return (1974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:04:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.980s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.375s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e5136aa-9c1d-4aee-91ad-3886845b85ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-106de322-0fe6-4ef7-b33c-742d7ee30850', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dfb7d65-d161-44ba-8334-d886c26232d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] Creating offline snapshot 0ab9dd96-00cd-40c1-989f-941a3a82f671 of volume 20f09412-dfc3-4a9a-afea-40871bba0602 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:04:32 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Volume volume-106de322-0fe6-4ef7-b33c-742d7ee30850 (106de322-0fe6-4ef7-b33c-742d7ee30850): created successfully Jul 09 10:04:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dfb7d65-d161-44ba-8334-d886c26232d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Flow 'volume_create_manager' (4a64df14-d730-4355-ace5-271e47c16af5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:04:33 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdc826f-326b-489a-b13e-afa173a7f8f1]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0f4a43c2-c231-426f-baac-a9284eed314c tempest-ServerActionsTestOtherA-66448965 None] Created volume successfully. Jul 09 10:04:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f78787f6-2cba-44b6-b74d-bb36792219f7 tempest-AttachVolumeTestJSON-1815239661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f78787f6-2cba-44b6-b74d-bb36792219f7 tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f78787f6-2cba-44b6-b74d-bb36792219f7 tempest-AttachVolumeTestJSON-1815239661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:04:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f78787f6-2cba-44b6-b74d-bb36792219f7 tempest-AttachVolumeTestJSON-1815239661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:04:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f78787f6-2cba-44b6-b74d-bb36792219f7 tempest-AttachVolumeTestJSON-1815239661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f78787f6-2cba-44b6-b74d-bb36792219f7 tempest-AttachVolumeTestJSON-1815239661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:33 devstack sudo[93809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:04:33 devstack sudo[93809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:33 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602 Jul 09 10:04:33 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:33 devstack sudo[93805]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c4cc2a66-2a61-40d3-84d6-9219f2ab50a9 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9444ee6c-4d70-43b8-96c6-12803417225e" returned: 0 in 0.796s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c4cc2a66-2a61-40d3-84d6-9219f2ab50a9 tempest-VolumesGetTest-104595405 None] Lock "cinder-quobyte-9444ee6c-4d70-43b8-96c6-12803417225e" released by "delete_volume" :: held 1.749s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:33 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c4cc2a66-2a61-40d3-84d6-9219f2ab50a9 tempest-VolumesGetTest-104595405 None] Created reservations ['7d9fe380-ff37-4c10-96c7-5e4bc3570b84', 'f7987566-d676-44b4-9f4d-2fe8443e684d', 'b8763ca1-81e6-454d-b2bf-7dcc40158e94', 'd685f1ec-aa53-40ad-91b2-86a123ad15c7'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:04:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c4cc2a66-2a61-40d3-84d6-9219f2ab50a9 tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c4cc2a66-2a61-40d3-84d6-9219f2ab50a9 tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c4cc2a66-2a61-40d3-84d6-9219f2ab50a9 tempest-VolumesGetTest-104595405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:04:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c4cc2a66-2a61-40d3-84d6-9219f2ab50a9 tempest-VolumesGetTest-104595405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:04:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c4cc2a66-2a61-40d3-84d6-9219f2ab50a9 tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c4cc2a66-2a61-40d3-84d6-9219f2ab50a9 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:33 devstack sudo[93813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:04:33 devstack sudo[93813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f78787f6-2cba-44b6-b74d-bb36792219f7 tempest-AttachVolumeTestJSON-1815239661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.845s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:33 devstack sudo[93809]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:33 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-f78787f6-2cba-44b6-b74d-bb36792219f7 tempest-AttachVolumeTestJSON-1815239661 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:04:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f78787f6-2cba-44b6-b74d-bb36792219f7 tempest-AttachVolumeTestJSON-1815239661 None] Deleted volume successfully. Jul 09 10:04:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f78787f6-2cba-44b6-b74d-bb36792219f7 tempest-AttachVolumeTestJSON-1815239661 None] Lock "cinder-25b1de4e-551f-41f6-9c4d-94e5f8244bb7-delete_volume" released by "delete_volume" :: held 3.480s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3e5037ae-c04e-4e7c-8034-7a26de2e3a0e tempest-VolumesGetTest-104595405 None] Acquiring lock "cinder-6515ff29-49c5-437e-9786-038ed8b5289b-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3e5037ae-c04e-4e7c-8034-7a26de2e3a0e tempest-VolumesGetTest-104595405 None] Lock "cinder-6515ff29-49c5-437e-9786-038ed8b5289b-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:34 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602" returned: 0 in 1.165s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.0ab9dd96-00cd-40c1-989f-941a3a82f671 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:34 devstack sudo[93823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.0ab9dd96-00cd-40c1-989f-941a3a82f671 1G Jul 09 10:04:34 devstack sudo[93823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3e5037ae-c04e-4e7c-8034-7a26de2e3a0e tempest-VolumesGetTest-104595405 None] Acquiring lock "cinder-quobyte-6515ff29-49c5-437e-9786-038ed8b5289b" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3e5037ae-c04e-4e7c-8034-7a26de2e3a0e tempest-VolumesGetTest-104595405 None] Lock "cinder-quobyte-6515ff29-49c5-437e-9786-038ed8b5289b" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:34 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[337758ea-fcd9-4a28-b61b-86f35591727d]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3e5037ae-c04e-4e7c-8034-7a26de2e3a0e tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6515ff29-49c5-437e-9786-038ed8b5289b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:34 devstack sudo[93813]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c4cc2a66-2a61-40d3-84d6-9219f2ab50a9 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.996s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:34 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-c4cc2a66-2a61-40d3-84d6-9219f2ab50a9 tempest-VolumesGetTest-104595405 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:04:34 devstack sudo[93826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6515ff29-49c5-437e-9786-038ed8b5289b Jul 09 10:04:34 devstack sudo[93826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:34 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c4cc2a66-2a61-40d3-84d6-9219f2ab50a9 tempest-VolumesGetTest-104595405 None] Deleted volume successfully. Jul 09 10:04:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c4cc2a66-2a61-40d3-84d6-9219f2ab50a9 tempest-VolumesGetTest-104595405 None] Lock "cinder-9444ee6c-4d70-43b8-96c6-12803417225e-delete_volume" released by "delete_volume" :: held 3.027s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:35 devstack sudo[93823]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.0ab9dd96-00cd-40c1-989f-941a3a82f671 1G" returned: 0 in 1.040s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20f09412-dfc3-4a9a-afea-40871bba0602 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.0ab9dd96-00cd-40c1-989f-941a3a82f671 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:35 devstack sudo[93835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20f09412-dfc3-4a9a-afea-40871bba0602 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.0ab9dd96-00cd-40c1-989f-941a3a82f671 Jul 09 10:04:35 devstack sudo[93835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:35 devstack sudo[93826]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3e5037ae-c04e-4e7c-8034-7a26de2e3a0e tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6515ff29-49c5-437e-9786-038ed8b5289b" returned: 0 in 1.069s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3e5037ae-c04e-4e7c-8034-7a26de2e3a0e tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6515ff29-49c5-437e-9786-038ed8b5289b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:35 devstack sudo[93838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6515ff29-49c5-437e-9786-038ed8b5289b Jul 09 10:04:35 devstack sudo[93838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:35 devstack sudo[93835]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-20f09412-dfc3-4a9a-afea-40871bba0602 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.0ab9dd96-00cd-40c1-989f-941a3a82f671" returned: 0 in 0.770s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:35 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.0ab9dd96-00cd-40c1-989f-941a3a82f671 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 10:04:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.0ab9dd96-00cd-40c1-989f-941a3a82f671 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:36 devstack sudo[93845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.0ab9dd96-00cd-40c1-989f-941a3a82f671 Jul 09 10:04:36 devstack sudo[93845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:36 devstack sudo[93838]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3e5037ae-c04e-4e7c-8034-7a26de2e3a0e tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6515ff29-49c5-437e-9786-038ed8b5289b" returned: 0 in 0.757s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3e5037ae-c04e-4e7c-8034-7a26de2e3a0e tempest-VolumesGetTest-104595405 None] Lock "cinder-quobyte-6515ff29-49c5-437e-9786-038ed8b5289b" released by "delete_volume" :: held 1.887s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:36 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-3e5037ae-c04e-4e7c-8034-7a26de2e3a0e tempest-VolumesGetTest-104595405 None] Created reservations ['09a67674-bb71-4601-9b24-118b9cfacb8c', '1b2b58dd-b2b3-49e6-9ee7-9f1a3ba08b1e', '4cf38d16-09ea-4d63-9c76-90b025d69caf', '85dc044d-9a0a-40a2-b141-1c1a404f7acf'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3e5037ae-c04e-4e7c-8034-7a26de2e3a0e tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3e5037ae-c04e-4e7c-8034-7a26de2e3a0e tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3e5037ae-c04e-4e7c-8034-7a26de2e3a0e tempest-VolumesGetTest-104595405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:04:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3e5037ae-c04e-4e7c-8034-7a26de2e3a0e tempest-VolumesGetTest-104595405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3e5037ae-c04e-4e7c-8034-7a26de2e3a0e tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3e5037ae-c04e-4e7c-8034-7a26de2e3a0e tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:36 devstack sudo[93847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:04:36 devstack sudo[93847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5fcf3bdc-f64b-445f-94e3-23526cd80d8c tempest-VolumesGetTest-104595405 None] Acquiring lock "cinder-4887f7a5-97dc-4f74-9329-2ebe8552f5d8-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5fcf3bdc-f64b-445f-94e3-23526cd80d8c tempest-VolumesGetTest-104595405 None] Lock "cinder-4887f7a5-97dc-4f74-9329-2ebe8552f5d8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5fcf3bdc-f64b-445f-94e3-23526cd80d8c tempest-VolumesGetTest-104595405 None] Acquiring lock "cinder-quobyte-4887f7a5-97dc-4f74-9329-2ebe8552f5d8" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5fcf3bdc-f64b-445f-94e3-23526cd80d8c tempest-VolumesGetTest-104595405 None] Lock "cinder-quobyte-4887f7a5-97dc-4f74-9329-2ebe8552f5d8" acquired by "delete_volume" :: waited 0.040s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:36 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0937d5ee-0eac-4b3a-a14e-f1dd919aff0c]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5fcf3bdc-f64b-445f-94e3-23526cd80d8c tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:36 devstack sudo[93845]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.0ab9dd96-00cd-40c1-989f-941a3a82f671" returned: 0 in 0.841s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:36 devstack sudo[93850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 Jul 09 10:04:36 devstack sudo[93850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:36 devstack sudo[93852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.info Jul 09 10:04:36 devstack sudo[93852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:37 devstack sudo[93847]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3e5037ae-c04e-4e7c-8034-7a26de2e3a0e tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.838s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:37 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-3e5037ae-c04e-4e7c-8034-7a26de2e3a0e tempest-VolumesGetTest-104595405 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:04:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3e5037ae-c04e-4e7c-8034-7a26de2e3a0e tempest-VolumesGetTest-104595405 None] Deleted volume successfully. Jul 09 10:04:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3e5037ae-c04e-4e7c-8034-7a26de2e3a0e tempest-VolumesGetTest-104595405 None] Lock "cinder-6515ff29-49c5-437e-9786-038ed8b5289b-delete_volume" released by "delete_volume" :: held 3.038s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:37 devstack sudo[93852]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.info" returned: 0 in 0.807s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:37 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 10:04:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:37 devstack sudo[93860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.info Jul 09 10:04:37 devstack sudo[93860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:37 devstack sudo[93850]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5fcf3bdc-f64b-445f-94e3-23526cd80d8c tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8" returned: 0 in 1.024s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5fcf3bdc-f64b-445f-94e3-23526cd80d8c tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:37 devstack sudo[93862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8 Jul 09 10:04:37 devstack sudo[93862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:38 devstack sudo[93860]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:38 devstack sudo[93862]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.info" returned: 0 in 0.726s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.561s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5fcf3bdc-f64b-445f-94e3-23526cd80d8c tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4887f7a5-97dc-4f74-9329-2ebe8552f5d8" returned: 0 in 0.735s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5fcf3bdc-f64b-445f-94e3-23526cd80d8c tempest-VolumesGetTest-104595405 None] Lock "cinder-quobyte-4887f7a5-97dc-4f74-9329-2ebe8552f5d8" released by "delete_volume" :: held 1.884s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:38 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-58faff91-4887-4fb9-8a1d-cf21bde3ab6e tempest-GroupSnapshotsTest-1578681694 None] group_snapshot 081ad64b-9cfd-463b-b374-6dd3d7b248df: created successfully Jul 09 10:04:38 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-5fcf3bdc-f64b-445f-94e3-23526cd80d8c tempest-VolumesGetTest-104595405 None] Created reservations ['b7325c1b-bfb8-4253-b772-3c99f5c29027', '6b2c0b5c-7065-412b-a226-edab3848a7fe', 'af4007e7-3ede-4838-b00b-d8b2d7047ece', '72ae9071-5b76-4989-9c8c-24b5483b397d'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5fcf3bdc-f64b-445f-94e3-23526cd80d8c tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5fcf3bdc-f64b-445f-94e3-23526cd80d8c tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5fcf3bdc-f64b-445f-94e3-23526cd80d8c tempest-VolumesGetTest-104595405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:04:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5fcf3bdc-f64b-445f-94e3-23526cd80d8c tempest-VolumesGetTest-104595405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5fcf3bdc-f64b-445f-94e3-23526cd80d8c tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5fcf3bdc-f64b-445f-94e3-23526cd80d8c tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:38 devstack sudo[93867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:04:38 devstack sudo[93867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:39 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] group_snapshot 081ad64b-9cfd-463b-b374-6dd3d7b248df: deleting Jul 09 10:04:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] group_snapshot 081ad64b-9cfd-463b-b374-6dd3d7b248df: deleting {{(pid=87192) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 10:04:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "cinder-quobyte-20f09412-dfc3-4a9a-afea-40871bba0602" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-20f09412-dfc3-4a9a-afea-40871bba0602" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "cinder-quobyte-0ab9dd96-00cd-40c1-989f-941a3a82f671" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-0ab9dd96-00cd-40c1-989f-941a3a82f671" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] Deleting offline snapshot 0ab9dd96-00cd-40c1-989f-941a3a82f671 of volume 20f09412-dfc3-4a9a-afea-40871bba0602 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:04:39 devstack sudo[93867]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] snapshot_file for this snap is: volume-20f09412-dfc3-4a9a-afea-40871bba0602.0ab9dd96-00cd-40c1-989f-941a3a82f671 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:04:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5fcf3bdc-f64b-445f-94e3-23526cd80d8c tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.914s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:39 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-5fcf3bdc-f64b-445f-94e3-23526cd80d8c tempest-VolumesGetTest-104595405 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:04:39 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5fcf3bdc-f64b-445f-94e3-23526cd80d8c tempest-VolumesGetTest-104595405 None] Deleted volume successfully. Jul 09 10:04:39 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a1ac7e1-5855-415c-9692-eefc46be94ca]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.0ab9dd96-00cd-40c1-989f-941a3a82f671 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5fcf3bdc-f64b-445f-94e3-23526cd80d8c tempest-VolumesGetTest-104595405 None] Lock "cinder-4887f7a5-97dc-4f74-9329-2ebe8552f5d8-delete_volume" released by "delete_volume" :: held 3.190s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:39 devstack sudo[93870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.0ab9dd96-00cd-40c1-989f-941a3a82f671 Jul 09 10:04:39 devstack sudo[93870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:40 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:04:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Flow 'volume_create_manager' (957fbdb9-e1ee-4b0b-bf68-39d18f56ca63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:04:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab092d2-da81-4658-b60d-dcdaadc3e40f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ab092d2-da81-4658-b60d-dcdaadc3e40f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1569447280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ffe82d-b1af-45d1-9572-8b80b67ad999,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d4e8c67a26074cb7adce8781f9ec8ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:04:41Z,use_quota=True,user_id='16d4e9791c944677a6a4b01e6a823cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6200baf-6537-45ea-ac75-0f5f3c780114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6200baf-6537-45ea-ac75-0f5f3c780114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4d8cbf-2f61-4b33-b652-5aa28f129c88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:40 devstack cinder-volume[87192]: DEBUG cinder.image.glance [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Creating Keystone auth plugin from conf {{(pid=87192) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 10:04:40 devstack sudo[93870]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.0ab9dd96-00cd-40c1-989f-941a3a82f671" returned: 0 in 1.171s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-20f09412-dfc3-4a9a-afea-40871bba0602(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:04:40 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ddef010-718e-4ef1-a706-59b94928c920]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:40 devstack sudo[93882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602 Jul 09 10:04:40 devstack sudo[93882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:41 devstack sudo[93882]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602" returned: 0 in 1.001s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.0ab9dd96-00cd-40c1-989f-941a3a82f671 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:41 devstack sudo[93903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.0ab9dd96-00cd-40c1-989f-941a3a82f671 Jul 09 10:04:41 devstack sudo[93903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf4d8cbf-2f61-4b33-b652-5aa28f129c88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'f4ffe82d-b1af-45d1-9572-8b80b67ad999', 'volume_name': 'volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999', 'volume_size': 1, 'image_id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fbd1c6e24b394cf998d7f93c3a7d72f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'created_at': datetime.datetime(2026, 7, 9, 7, 52, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 52, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e786bc-01d9-4b31-b950-43d1ae239457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (18e786bc-01d9-4b31-b950-43d1ae239457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec8a797-d751-4b68-9824-69f0b0cc6b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:41 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Volume f4ffe82d-b1af-45d1-9572-8b80b67ad999: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999', 'volume_size': 1, 'image_id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fbd1c6e24b394cf998d7f93c3a7d72f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'created_at': datetime.datetime(2026, 7, 9, 7, 52, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 52, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 10:04:41 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Trying to clone f4ffe82d-b1af-45d1-9572-8b80b67ad999 from image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}]). {{(pid=87192) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 10:04:42 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_kkmmxqladevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 10:04:42 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Image download 20.69 MB at 20.69 MB/s Jul 09 10:04:42 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0de0495-b210-4865-8e71-db107de90510]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_kkmmxqladevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:42 devstack sudo[93926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_kkmmxqladevstack@QuobyteHD Jul 09 10:04:42 devstack sudo[93926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:42 devstack sudo[93903]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.0ab9dd96-00cd-40c1-989f-941a3a82f671" returned: 0 in 1.014s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.0ab9dd96-00cd-40c1-989f-941a3a82f671 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:42 devstack sudo[93931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.0ab9dd96-00cd-40c1-989f-941a3a82f671 Jul 09 10:04:42 devstack sudo[93931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:43 devstack sudo[93926]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_kkmmxqladevstack@QuobyteHD" returned: 0 in 0.872s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:43 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Temporary image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 is fetched for user 16d4e9791c944677a6a4b01e6a823cd4. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 10:04:43 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e08313bb-f3a4-4b25-b64c-33663a58474f]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_kkmmxqladevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:43 devstack sudo[93938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_kkmmxqladevstack@QuobyteHD Jul 09 10:04:43 devstack sudo[93938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:43 devstack sudo[93931]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602.0ab9dd96-00cd-40c1-989f-941a3a82f671" returned: 0 in 0.751s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-0ab9dd96-00cd-40c1-989f-941a3a82f671" released by "_delete_snapshot" :: held 4.168s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-20f09412-dfc3-4a9a-afea-40871bba0602" released by "delete_snapshot" :: held 4.220s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:43 devstack cinder-volume[87192]: WARNING cinder.quota [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1821295200 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1821295200, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:04:43 devstack cinder-volume[87192]: WARNING cinder.quota [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1821295200 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1821295200, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:04:43 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] Created reservations ['d58727bf-c041-4a2e-978a-96d702dc3e4d', '33948128-bb3c-4768-92b5-6234343b2011', '7b93c643-3556-4348-aa7e-d33d9ab00947', '1f06cee1-e4b4-405f-bfbd-5690c1dc2e29'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:04:43 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-552f930d-06f3-402b-b13f-c95cbaae360a tempest-GroupSnapshotsTest-1578681694 None] group_snapshot 081ad64b-9cfd-463b-b374-6dd3d7b248df: deleted successfully Jul 09 10:04:44 devstack sudo[93938]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_kkmmxqladevstack@QuobyteHD" returned: 0 in 0.918s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:04:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1569447280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4ffe82d-b1af-45d1-9572-8b80b67ad999,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='d4e8c67a26074cb7adce8781f9ec8ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:04:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:04:41Z,use_quota=True,user_id='16d4e9791c944677a6a4b01e6a823cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:04:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Creating volume f4ffe82d-b1af-45d1-9572-8b80b67ad999 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:04:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:04:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:04:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:04:44 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:04:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:44 devstack sudo[93944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 1073741824 Jul 09 10:04:44 devstack sudo[93944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c2faaa79-a8dd-40a3-902c-6f374873ffbd tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "cinder-quobyte-20f09412-dfc3-4a9a-afea-40871bba0602" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:04:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c2faaa79-a8dd-40a3-902c-6f374873ffbd tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-20f09412-dfc3-4a9a-afea-40871bba0602" acquired by "delete_volume" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:04:44 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[da1773c4-2b25-4628-97b4-355cb5b36856]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2faaa79-a8dd-40a3-902c-6f374873ffbd tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:44 devstack sudo[93946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602 Jul 09 10:04:44 devstack sudo[93946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:45 devstack sudo[93944]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 1073741824" returned: 0 in 1.146s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:45 devstack sudo[93972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 Jul 09 10:04:45 devstack sudo[93972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:45 devstack sudo[93946]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2faaa79-a8dd-40a3-902c-6f374873ffbd tempest-GroupSnapshotsTest-1578681694 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602" returned: 0 in 1.091s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2faaa79-a8dd-40a3-902c-6f374873ffbd tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:45 devstack sudo[93975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602 Jul 09 10:04:45 devstack sudo[93975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:46 devstack sudo[93975]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2faaa79-a8dd-40a3-902c-6f374873ffbd tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-20f09412-dfc3-4a9a-afea-40871bba0602" returned: 0 in 0.799s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:46 devstack sudo[93972]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999" returned: 0 in 0.877s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] <== create_volume: return (2084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:04:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.086s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c2faaa79-a8dd-40a3-902c-6f374873ffbd tempest-GroupSnapshotsTest-1578681694 None] Lock "cinder-quobyte-20f09412-dfc3-4a9a-afea-40871bba0602" released by "delete_volume" :: held 1.955s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:04:46 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Attempting download of fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}])) to volume f4ffe82d-b1af-45d1-9572-8b80b67ad999. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 10:04:46 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c2faaa79-a8dd-40a3-902c-6f374873ffbd tempest-GroupSnapshotsTest-1578681694 None] Created reservations ['cd90e13a-c36c-48fa-be4d-9393e63592cc'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:04:46 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[664b428f-9253-4218-b8cf-fc3a0e96fb52]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_ebcd8hq1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:46 devstack cinder-volume[87192]: WARNING cinder.quota [None req-c2faaa79-a8dd-40a3-902c-6f374873ffbd tempest-GroupSnapshotsTest-1578681694 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1821295200 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1821295200, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:04:46 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c2faaa79-a8dd-40a3-902c-6f374873ffbd tempest-GroupSnapshotsTest-1578681694 None] Created reservations ['99edb433-11d8-461b-a800-e0ca13da6f4d', 'e5a94bb2-afb4-4b88-b6f6-ded5b48f06f1', '1dcaabc4-ed26-4517-9643-5ae37ff935c7', '0a4d50bf-09c4-46df-88a1-3305b1c8870c'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:04:46 devstack sudo[93983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_ebcd8hq1 Jul 09 10:04:46 devstack sudo[93983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c2faaa79-a8dd-40a3-902c-6f374873ffbd tempest-GroupSnapshotsTest-1578681694 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c2faaa79-a8dd-40a3-902c-6f374873ffbd tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c2faaa79-a8dd-40a3-902c-6f374873ffbd tempest-GroupSnapshotsTest-1578681694 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:04:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c2faaa79-a8dd-40a3-902c-6f374873ffbd tempest-GroupSnapshotsTest-1578681694 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:04:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c2faaa79-a8dd-40a3-902c-6f374873ffbd tempest-GroupSnapshotsTest-1578681694 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2faaa79-a8dd-40a3-902c-6f374873ffbd tempest-GroupSnapshotsTest-1578681694 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:46 devstack sudo[93985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:04:46 devstack sudo[93985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:47 devstack sudo[93985]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2faaa79-a8dd-40a3-902c-6f374873ffbd tempest-GroupSnapshotsTest-1578681694 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.059s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:47 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-c2faaa79-a8dd-40a3-902c-6f374873ffbd tempest-GroupSnapshotsTest-1578681694 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:04:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c2faaa79-a8dd-40a3-902c-6f374873ffbd tempest-GroupSnapshotsTest-1578681694 None] Delete group completed successfully. Jul 09 10:04:47 devstack sudo[93983]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_ebcd8hq1" returned: 0 in 1.307s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_ebcd8hq1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:47 devstack sudo[94010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_ebcd8hq1 Jul 09 10:04:47 devstack sudo[94010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:49 devstack sudo[94010]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_ebcd8hq1" returned: 1 in 1.318s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_ebcd8hq1' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:04:49 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3338293-39dd-4a4a-ac07-13fd7c7110f2]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_kkmmxqladevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:49 devstack sudo[94017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_kkmmxqladevstack@QuobyteHD Jul 09 10:04:49 devstack sudo[94017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:50 devstack sudo[94017]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_kkmmxqladevstack@QuobyteHD" returned: 0 in 1.547s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:50 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 was qcow2, converting to raw {{(pid=87192) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 10:04:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_kkmmxqladevstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:50 devstack sudo[94022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_kkmmxqladevstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 Jul 09 10:04:50 devstack sudo[94022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:53 devstack sudo[94022]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_kkmmxqladevstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999" returned: 0 in 2.967s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:53 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_kkmmxqladevstack@QuobyteHD, size 112.00 MB, duration 2.97 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:04:53 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Converted 112.00 MB image at 37.73 MB/s Jul 09 10:04:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:53 devstack sudo[94037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 1G Jul 09 10:04:53 devstack sudo[94037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:54 devstack sudo[94037]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 1G" returned: 0 in 1.284s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:54 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8934e76-6b0f-43c8-87a7-eab8b9f31bad]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:04:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:55 devstack sudo[94042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 Jul 09 10:04:55 devstack sudo[94042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:56 devstack sudo[94042]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999" returned: 0 in 1.222s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:56 devstack sudo[94046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 Jul 09 10:04:56 devstack sudo[94046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:56 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=96,cinder:SELECT=71,cinder:INSERT=23,cinder:DELETE=7 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:04:56 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=78,cinder:UPDATE=106,cinder:INSERT=26,cinder:DELETE=3 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:04:57 devstack sudo[94046]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999" returned: 1 in 0.935s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Downloaded image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}])) to volume f4ffe82d-b1af-45d1-9572-8b80b67ad999 successfully. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 10:04:57 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Temporary image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 for user 16d4e9791c944677a6a4b01e6a823cd4 is deleted. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 10:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Marking volume f4ffe82d-b1af-45d1-9572-8b80b67ad999 as bootable. {{(pid=87192) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 10:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Copying metadata from image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 to f4ffe82d-b1af-45d1-9572-8b80b67ad999. {{(pid=87192) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 10:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Creating volume glance metadata for volume f4ffe82d-b1af-45d1-9572-8b80b67ad999 backed by image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87192) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 10:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ec8a797-d751-4b68-9824-69f0b0cc6b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999', 'volume_size': 1, 'image_id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fbd1c6e24b394cf998d7f93c3a7d72f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'created_at': datetime.datetime(2026, 7, 9, 7, 52, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 52, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ba5ff3-6dd0-4602-95ca-c078f6671977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Volume volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 (f4ffe82d-b1af-45d1-9572-8b80b67ad999): created successfully Jul 09 10:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7ba5ff3-6dd0-4602-95ca-c078f6671977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Flow 'volume_create_manager' (957fbdb9-e1ee-4b0b-bf68-39d18f56ca63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:04:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4d298628-43bf-40c7-b087-9fa159335edd tempest-VolumesGetTest-104595405 None] Created volume successfully. Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Flow 'volume_create_manager' (1b3855e8-cdfe-4e45-97a9-a21650e20056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265b31f0-852b-4fe0-ac2c-41a0374415e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (265b31f0-852b-4fe0-ac2c-41a0374415e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:04:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-183216547',display_name='tempest-VolumesGetTest-Volume-347646816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bcb3ce7-d1a4-4e40-80ad-8f82b863676e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e8c67a26074cb7adce8781f9ec8ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:04:59Z,use_quota=True,user_id='16d4e9791c944677a6a4b01e6a823cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c55134-5c80-45c5-8ba3-117b5e3e1daa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3c55134-5c80-45c5-8ba3-117b5e3e1daa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d75ba71-045a-4487-a038-2aaee8d8e57f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0d75ba71-045a-4487-a038-2aaee8d8e57f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bcb3ce7-d1a4-4e40-80ad-8f82b863676e', 'volume_name': 'volume-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46a8b27-6642-424c-9735-8c3498207899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e46a8b27-6642-424c-9735-8c3498207899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2752ce-2805-4b6c-bb21-e05a930b157f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:04:58 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Volume 6bcb3ce7-d1a4-4e40-80ad-8f82b863676e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e', 'volume_size': 1} Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:04:58Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-183216547',display_name='tempest-VolumesGetTest-Volume-347646816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bcb3ce7-d1a4-4e40-80ad-8f82b863676e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4e8c67a26074cb7adce8781f9ec8ebe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:04:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:04:59Z,use_quota=True,user_id='16d4e9791c944677a6a4b01e6a823cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Creating volume 6bcb3ce7-d1a4-4e40-80ad-8f82b863676e {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:04:58 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:04:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:58 devstack sudo[94052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e 1073741824 Jul 09 10:04:58 devstack sudo[94052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:04:59 devstack sudo[94052]: pam_unix(sudo:session): session closed for user root Jul 09 10:04:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e 1073741824" returned: 0 in 1.052s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:04:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:04:59 devstack sudo[94058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e Jul 09 10:04:59 devstack sudo[94058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:00 devstack sudo[94058]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e" returned: 0 in 0.926s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] <== create_volume: return (2034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:05:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.037s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a2752ce-2805-4b6c-bb21-e05a930b157f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e309c0-4e5e-4e9b-bb32-b820903e782c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:00 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Volume volume-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e (6bcb3ce7-d1a4-4e40-80ad-8f82b863676e): created successfully Jul 09 10:05:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54e309c0-4e5e-4e9b-bb32-b820903e782c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Flow 'volume_create_manager' (1b3855e8-cdfe-4e45-97a9-a21650e20056) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:05:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-33541a4d-4163-45e9-af49-daad4b6ce449 tempest-VolumesGetTest-104595405 None] Created volume successfully. Jul 09 10:05:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7e2c5b91-29ae-4025-acad-c3c6974d019e tempest-VolumesGetTest-104595405 None] Acquiring lock "cinder-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:05:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7e2c5b91-29ae-4025-acad-c3c6974d019e tempest-VolumesGetTest-104595405 None] Lock "cinder-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:05:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7e2c5b91-29ae-4025-acad-c3c6974d019e tempest-VolumesGetTest-104595405 None] Acquiring lock "cinder-quobyte-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:05:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7e2c5b91-29ae-4025-acad-c3c6974d019e tempest-VolumesGetTest-104595405 None] Lock "cinder-quobyte-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:05:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb7eefcb-b811-42e4-8e27-dc27c7449326]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7e2c5b91-29ae-4025-acad-c3c6974d019e tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:02 devstack sudo[94084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e Jul 09 10:05:02 devstack sudo[94084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8e07ac2f-2f04-453f-a76f-5bbafe23bb88 tempest-GroupsV320Test-775808180 None] Group tempest-GroupsV320Test-Group-1492752460: creating Jul 09 10:05:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8e07ac2f-2f04-453f-a76f-5bbafe23bb88 tempest-GroupsV320Test-775808180 None] Group tempest-GroupsV320Test-Group-1492752460: created successfully Jul 09 10:05:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8e07ac2f-2f04-453f-a76f-5bbafe23bb88 tempest-GroupsV320Test-775808180 None] Create group completed successfully. Jul 09 10:05:02 devstack sudo[94084]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7e2c5b91-29ae-4025-acad-c3c6974d019e tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e" returned: 0 in 0.807s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7e2c5b91-29ae-4025-acad-c3c6974d019e tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:02 devstack sudo[94090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e Jul 09 10:05:02 devstack sudo[94090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:03 devstack sudo[94090]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7e2c5b91-29ae-4025-acad-c3c6974d019e tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e" returned: 0 in 0.658s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7e2c5b91-29ae-4025-acad-c3c6974d019e tempest-VolumesGetTest-104595405 None] Lock "cinder-quobyte-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e" released by "delete_volume" :: held 1.514s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:05:03 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-7e2c5b91-29ae-4025-acad-c3c6974d019e tempest-VolumesGetTest-104595405 None] Created reservations ['4302d1fd-fad6-49e7-b4af-c4586c117a63', '679a4746-081e-4e74-bc7f-d8d7a147c2cd', 'f46713c7-822e-49cf-be35-5561745c9951', 'a26bdc5d-4a56-4c95-a82f-b690ce237050'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:05:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7e2c5b91-29ae-4025-acad-c3c6974d019e tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7e2c5b91-29ae-4025-acad-c3c6974d019e tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7e2c5b91-29ae-4025-acad-c3c6974d019e tempest-VolumesGetTest-104595405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:05:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7e2c5b91-29ae-4025-acad-c3c6974d019e tempest-VolumesGetTest-104595405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:05:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7e2c5b91-29ae-4025-acad-c3c6974d019e tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7e2c5b91-29ae-4025-acad-c3c6974d019e tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:03 devstack sudo[94093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:05:03 devstack sudo[94093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:03 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d852d902-1df3-452e-8132-39996d54399a tempest-GroupsV320Test-775808180 None] Created reservations ['8477cc48-7339-4105-bf95-83743f41e01e'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:05:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d852d902-1df3-452e-8132-39996d54399a tempest-GroupsV320Test-775808180 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d852d902-1df3-452e-8132-39996d54399a tempest-GroupsV320Test-775808180 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d852d902-1df3-452e-8132-39996d54399a tempest-GroupsV320Test-775808180 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:05:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d852d902-1df3-452e-8132-39996d54399a tempest-GroupsV320Test-775808180 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:05:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d852d902-1df3-452e-8132-39996d54399a tempest-GroupsV320Test-775808180 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d852d902-1df3-452e-8132-39996d54399a tempest-GroupsV320Test-775808180 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:04 devstack sudo[94095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:05:04 devstack sudo[94095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] Acquiring lock "cinder-f4ffe82d-b1af-45d1-9572-8b80b67ad999-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:05:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] Lock "cinder-f4ffe82d-b1af-45d1-9572-8b80b67ad999-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:05:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] Acquiring lock "cinder-quobyte-f4ffe82d-b1af-45d1-9572-8b80b67ad999" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:05:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] Lock "cinder-quobyte-f4ffe82d-b1af-45d1-9572-8b80b67ad999" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:05:04 devstack sudo[94093]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7e2c5b91-29ae-4025-acad-c3c6974d019e tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.675s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:04 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-7e2c5b91-29ae-4025-acad-c3c6974d019e tempest-VolumesGetTest-104595405 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:05:04 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d584663-1938-455c-9eb0-32f0e8f7519c]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7e2c5b91-29ae-4025-acad-c3c6974d019e tempest-VolumesGetTest-104595405 None] Deleted volume successfully. Jul 09 10:05:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7e2c5b91-29ae-4025-acad-c3c6974d019e tempest-VolumesGetTest-104595405 None] Lock "cinder-6bcb3ce7-d1a4-4e40-80ad-8f82b863676e-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:05:04 devstack sudo[94098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 Jul 09 10:05:04 devstack sudo[94098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:04 devstack sudo[94095]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d852d902-1df3-452e-8132-39996d54399a tempest-GroupsV320Test-775808180 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.742s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:04 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-d852d902-1df3-452e-8132-39996d54399a tempest-GroupsV320Test-775808180 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:05:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d852d902-1df3-452e-8132-39996d54399a tempest-GroupsV320Test-775808180 None] Delete group completed successfully. Jul 09 10:05:05 devstack sudo[94098]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999" returned: 0 in 0.802s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:05 devstack sudo[94105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 Jul 09 10:05:05 devstack sudo[94105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:06 devstack sudo[94105]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999" returned: 1 in 0.834s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:05:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:06 devstack sudo[94110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999 Jul 09 10:05:06 devstack sudo[94110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:07 devstack sudo[94110]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f4ffe82d-b1af-45d1-9572-8b80b67ad999" returned: 0 in 0.883s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] Lock "cinder-quobyte-f4ffe82d-b1af-45d1-9572-8b80b67ad999" released by "delete_volume" :: held 2.633s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:05:07 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] Created reservations ['43966ba2-ed73-4035-8a46-a3b964eb7cca', '65964109-7874-4f0a-b0f6-ba657f02614e', 'a14bfe58-a670-4daa-adfc-9fce209e1179', 'e16f6606-4d37-4e61-b0a3-33f9dea43614'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:05:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:05:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:05:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:07 devstack sudo[94113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:05:07 devstack sudo[94113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:08 devstack sudo[94113]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.189s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:08 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:05:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] Deleted volume successfully. Jul 09 10:05:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f5f84dd-e183-4275-89a5-ed749de610ee tempest-VolumesGetTest-104595405 None] Lock "cinder-f4ffe82d-b1af-45d1-9572-8b80b67ad999-delete_volume" released by "delete_volume" :: held 4.267s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Flow 'volume_create_manager' (c417c974-d78a-471a-be6b-505f3937e40e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e9571c-e16c-400d-86cf-9a021ccc3a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e9571c-e16c-400d-86cf-9a021ccc3a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1258348000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc07fdc9-5249-45b9-b457-6ecae953f979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37467518ffeb433bb9131164be8d1434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:05:11Z,use_quota=True,user_id='307b6e7ac2854f38a5d6f8809ed0c62d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471bf9f1-d094-4795-885d-fb93efb41c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (471bf9f1-d094-4795-885d-fb93efb41c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcda91a0-5a17-41ae-8bb2-6c51533f7df5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcda91a0-5a17-41ae-8bb2-6c51533f7df5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc07fdc9-5249-45b9-b457-6ecae953f979', 'volume_name': 'volume-fc07fdc9-5249-45b9-b457-6ecae953f979', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2fa68fc-57ba-45a4-9996-19cb594f40e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2fa68fc-57ba-45a4-9996-19cb594f40e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee36dff5-e273-4e1d-b32a-3b3b4da77a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:11 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Volume fc07fdc9-5249-45b9-b457-6ecae953f979: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc07fdc9-5249-45b9-b457-6ecae953f979', 'volume_size': 1} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1258348000',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc07fdc9-5249-45b9-b457-6ecae953f979,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='37467518ffeb433bb9131164be8d1434',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:05:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:05:11Z,use_quota=True,user_id='307b6e7ac2854f38a5d6f8809ed0c62d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Creating volume fc07fdc9-5249-45b9-b457-6ecae953f979 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:05:11 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:11 devstack sudo[94134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979 1073741824 Jul 09 10:05:11 devstack sudo[94134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Flow 'volume_create_manager' (eba24982-1635-41c4-9529-64e6fac21c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde30792-c1fa-44d3-bf05-f60952430b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde30792-c1fa-44d3-bf05-f60952430b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1828916436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ac37061-de09-400e-ba0b-4deb56a6f83d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1382bcb488a4ae4b47063a800ac11ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:05:12Z,use_quota=True,user_id='1140765b31434c8dadf56841d0d65b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea81fe2-4f06-42dc-8856-9cd68e2af6c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cea81fe2-4f06-42dc-8856-9cd68e2af6c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33082771-06e2-4bc6-bafe-509cb2343e50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33082771-06e2-4bc6-bafe-509cb2343e50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ac37061-de09-400e-ba0b-4deb56a6f83d', 'volume_name': 'volume-9ac37061-de09-400e-ba0b-4deb56a6f83d', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a563ad2-6c60-4032-94b3-b2867f11e169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a563ad2-6c60-4032-94b3-b2867f11e169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe37b64-5365-4da4-9c3e-132cc27f5a3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:11 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Volume 9ac37061-de09-400e-ba0b-4deb56a6f83d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ac37061-de09-400e-ba0b-4deb56a6f83d', 'volume_size': 1} Jul 09 10:05:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:12 devstack sudo[94134]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979 1073741824" returned: 0 in 0.875s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:12 devstack sudo[94140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979 Jul 09 10:05:12 devstack sudo[94140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:13 devstack sudo[94140]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979" returned: 0 in 0.835s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:05:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.548s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:05:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1828916436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ac37061-de09-400e-ba0b-4deb56a6f83d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1382bcb488a4ae4b47063a800ac11ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:05:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:05:12Z,use_quota=True,user_id='1140765b31434c8dadf56841d0d65b8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:05:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Creating volume 9ac37061-de09-400e-ba0b-4deb56a6f83d {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:05:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:05:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:05:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:05:13 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:05:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9ac37061-de09-400e-ba0b-4deb56a6f83d 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee36dff5-e273-4e1d-b32a-3b3b4da77a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc07fdc9-5249-45b9-b457-6ecae953f979', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29149b3a-b086-4ea9-b568-40a0daee16fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:13 devstack sudo[94180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9ac37061-de09-400e-ba0b-4deb56a6f83d 1073741824 Jul 09 10:05:13 devstack sudo[94180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:13 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Volume volume-fc07fdc9-5249-45b9-b457-6ecae953f979 (fc07fdc9-5249-45b9-b457-6ecae953f979): created successfully Jul 09 10:05:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29149b3a-b086-4ea9-b568-40a0daee16fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Flow 'volume_create_manager' (c417c974-d78a-471a-be6b-505f3937e40e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:05:13 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0d723a40-56d6-4c39-ae9c-c36b5dfabe8f tempest-VolumesSnapshotListTestJSON-1659100387 None] Created volume successfully. Jul 09 10:05:14 devstack sudo[94180]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9ac37061-de09-400e-ba0b-4deb56a6f83d 1073741824" returned: 0 in 1.021s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9ac37061-de09-400e-ba0b-4deb56a6f83d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:14 devstack sudo[94202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9ac37061-de09-400e-ba0b-4deb56a6f83d Jul 09 10:05:14 devstack sudo[94202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef2bf375-825e-4b22-9f94-c1e6cf4eb045 tempest-VolumesSnapshotListTestJSON-1659100387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:15 devstack sudo[94202]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9ac37061-de09-400e-ba0b-4deb56a6f83d" returned: 0 in 0.779s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:05:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.850s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef2bf375-825e-4b22-9f94-c1e6cf4eb045 tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.298s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-ef2bf375-825e-4b22-9f94-c1e6cf4eb045 tempest-VolumesSnapshotListTestJSON-1659100387 None] Creating offline snapshot 11e892ee-52ec-40a0-a468-6bb187d0550f of volume fc07fdc9-5249-45b9-b457-6ecae953f979 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:05:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abe37b64-5365-4da4-9c3e-132cc27f5a3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ac37061-de09-400e-ba0b-4deb56a6f83d', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a885851-077a-48f1-8914-0c4d5f8ee877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:15 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8e13bc-2c75-44f2-a277-03cc77ae9f8e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef2bf375-825e-4b22-9f94-c1e6cf4eb045 tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:15 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Volume volume-9ac37061-de09-400e-ba0b-4deb56a6f83d (9ac37061-de09-400e-ba0b-4deb56a6f83d): created successfully Jul 09 10:05:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a885851-077a-48f1-8914-0c4d5f8ee877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Flow 'volume_create_manager' (eba24982-1635-41c4-9529-64e6fac21c7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:05:15 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5137aef3-4fcd-4dbe-9c17-19cda8cdd110 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Created volume successfully. Jul 09 10:05:15 devstack sudo[94225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979 Jul 09 10:05:15 devstack sudo[94225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:15 devstack sudo[94225]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef2bf375-825e-4b22-9f94-c1e6cf4eb045 tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979" returned: 0 in 0.838s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef2bf375-825e-4b22-9f94-c1e6cf4eb045 tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:15 devstack sudo[94232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f 1G Jul 09 10:05:15 devstack sudo[94232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:17 devstack sudo[94232]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef2bf375-825e-4b22-9f94-c1e6cf4eb045 tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f 1G" returned: 0 in 1.213s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef2bf375-825e-4b22-9f94-c1e6cf4eb045 tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc07fdc9-5249-45b9-b457-6ecae953f979 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:17 devstack sudo[94247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc07fdc9-5249-45b9-b457-6ecae953f979 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f Jul 09 10:05:17 devstack sudo[94247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-ed74f1fc-f44f-4758-b549-5b7f329f3cdb req-09483b60-250c-44f6-8134-0e288e258601 tempest-ServerActionsTestOtherA-66448965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2dd297be-9153-4c72-8bb7-a8189d28f804 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Acquiring lock "cinder-9ac37061-de09-400e-ba0b-4deb56a6f83d-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:05:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2dd297be-9153-4c72-8bb7-a8189d28f804 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Lock "cinder-9ac37061-de09-400e-ba0b-4deb56a6f83d-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:05:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2dd297be-9153-4c72-8bb7-a8189d28f804 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Acquiring lock "cinder-quobyte-9ac37061-de09-400e-ba0b-4deb56a6f83d" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:05:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2dd297be-9153-4c72-8bb7-a8189d28f804 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Lock "cinder-quobyte-9ac37061-de09-400e-ba0b-4deb56a6f83d" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:05:17 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[919605d4-9ec3-4f44-9ede-35aee51b316a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2dd297be-9153-4c72-8bb7-a8189d28f804 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9ac37061-de09-400e-ba0b-4deb56a6f83d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:17 devstack sudo[94249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9ac37061-de09-400e-ba0b-4deb56a6f83d Jul 09 10:05:17 devstack sudo[94249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:18 devstack sudo[94247]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef2bf375-825e-4b22-9f94-c1e6cf4eb045 tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc07fdc9-5249-45b9-b457-6ecae953f979 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f" returned: 0 in 1.089s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:18 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-ef2bf375-825e-4b22-9f94-c1e6cf4eb045 tempest-VolumesSnapshotListTestJSON-1659100387 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f is being set with open permissions: ugo+rw Jul 09 10:05:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef2bf375-825e-4b22-9f94-c1e6cf4eb045 tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:18 devstack sudo[94258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f Jul 09 10:05:18 devstack sudo[94258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:18 devstack sudo[94249]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2dd297be-9153-4c72-8bb7-a8189d28f804 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9ac37061-de09-400e-ba0b-4deb56a6f83d" returned: 0 in 0.956s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2dd297be-9153-4c72-8bb7-a8189d28f804 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9ac37061-de09-400e-ba0b-4deb56a6f83d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:18 devstack sudo[94260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9ac37061-de09-400e-ba0b-4deb56a6f83d Jul 09 10:05:18 devstack sudo[94260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:19 devstack sudo[94258]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef2bf375-825e-4b22-9f94-c1e6cf4eb045 tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f" returned: 0 in 0.866s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef2bf375-825e-4b22-9f94-c1e6cf4eb045 tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:19 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.info Jul 09 10:05:19 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:19 devstack sudo[94260]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2dd297be-9153-4c72-8bb7-a8189d28f804 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9ac37061-de09-400e-ba0b-4deb56a6f83d" returned: 0 in 0.915s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2dd297be-9153-4c72-8bb7-a8189d28f804 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Lock "cinder-quobyte-9ac37061-de09-400e-ba0b-4deb56a6f83d" released by "delete_volume" :: held 1.959s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:05:19 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-2dd297be-9153-4c72-8bb7-a8189d28f804 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Created reservations ['c6bd801c-15b5-409a-b6e3-c20a12767d09', '479081be-ecdf-430a-ad31-39dfcc1a75e8', '648a7717-7b38-4eeb-96d0-d03b68944033', '5194a986-94b2-4ef1-a5f7-87e67852d094'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:05:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2dd297be-9153-4c72-8bb7-a8189d28f804 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2dd297be-9153-4c72-8bb7-a8189d28f804 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2dd297be-9153-4c72-8bb7-a8189d28f804 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:05:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2dd297be-9153-4c72-8bb7-a8189d28f804 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:05:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2dd297be-9153-4c72-8bb7-a8189d28f804 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2dd297be-9153-4c72-8bb7-a8189d28f804 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:19 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:05:19 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:20 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef2bf375-825e-4b22-9f94-c1e6cf4eb045 tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.info" returned: 0 in 1.007s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:20 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-ef2bf375-825e-4b22-9f94-c1e6cf4eb045 tempest-VolumesSnapshotListTestJSON-1659100387 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.info is being set with open permissions: ugo+rw Jul 09 10:05:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef2bf375-825e-4b22-9f94-c1e6cf4eb045 tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:20 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.info Jul 09 10:05:20 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:20 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2dd297be-9153-4c72-8bb7-a8189d28f804 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.901s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:20 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-2dd297be-9153-4c72-8bb7-a8189d28f804 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:05:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2dd297be-9153-4c72-8bb7-a8189d28f804 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Deleted volume successfully. Jul 09 10:05:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2dd297be-9153-4c72-8bb7-a8189d28f804 tempest-VolumeQuotasNegativeTestJSON-2082363634 None] Lock "cinder-9ac37061-de09-400e-ba0b-4deb56a6f83d-delete_volume" released by "delete_volume" :: held 3.199s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:05:20 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef2bf375-825e-4b22-9f94-c1e6cf4eb045 tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.info" returned: 0 in 0.787s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef2bf375-825e-4b22-9f94-c1e6cf4eb045 tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.942s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-ed74f1fc-f44f-4758-b549-5b7f329f3cdb req-09483b60-250c-44f6-8134-0e288e258601 tempest-ServerActionsTestOtherA-66448965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.796s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:21 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e2921df-6a30-4dcb-a9db-f78e015c3c47]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-ed74f1fc-f44f-4758-b549-5b7f329f3cdb req-09483b60-250c-44f6-8134-0e288e258601 tempest-ServerActionsTestOtherA-66448965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-106de322-0fe6-4ef7-b33c-742d7ee30850 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:21 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ef2bf375-825e-4b22-9f94-c1e6cf4eb045 tempest-VolumesSnapshotListTestJSON-1659100387 None] Create snapshot completed successfully Jul 09 10:05:21 devstack sudo[94275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-106de322-0fe6-4ef7-b33c-742d7ee30850 Jul 09 10:05:21 devstack sudo[94275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-417a7f8c-237f-4f13-a6c8-7a50c6ce9842 tempest-VolumesSnapshotListTestJSON-1659100387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:22 devstack sudo[94275]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-ed74f1fc-f44f-4758-b549-5b7f329f3cdb req-09483b60-250c-44f6-8134-0e288e258601 tempest-ServerActionsTestOtherA-66448965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-106de322-0fe6-4ef7-b33c-742d7ee30850" returned: 0 in 0.971s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-ed74f1fc-f44f-4758-b549-5b7f329f3cdb req-09483b60-250c-44f6-8134-0e288e258601 tempest-ServerActionsTestOtherA-66448965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.994s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-417a7f8c-237f-4f13-a6c8-7a50c6ce9842 tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.372s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-417a7f8c-237f-4f13-a6c8-7a50c6ce9842 tempest-VolumesSnapshotListTestJSON-1659100387 None] Creating offline snapshot d31e6626-b282-4ae0-b5d4-6a5914abef45 of volume fc07fdc9-5249-45b9-b457-6ecae953f979 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:05:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9494b857-93f3-4135-8980-a157a6e932f2]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-417a7f8c-237f-4f13-a6c8-7a50c6ce9842 tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-ed74f1fc-f44f-4758-b549-5b7f329f3cdb req-09483b60-250c-44f6-8134-0e288e258601 tempest-ServerActionsTestOtherA-66448965 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-106de322-0fe6-4ef7-b33c-742d7ee30850', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e37250a5-75be-45c5-b53a-c1b052fac653', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:05:22 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-ed74f1fc-f44f-4758-b549-5b7f329f3cdb req-09483b60-250c-44f6-8134-0e288e258601 tempest-ServerActionsTestOtherA-66448965 None] attachment_update completed successfully. Jul 09 10:05:22 devstack sudo[94280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f Jul 09 10:05:22 devstack sudo[94280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:23 devstack sudo[94280]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-417a7f8c-237f-4f13-a6c8-7a50c6ce9842 tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f" returned: 0 in 0.946s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-417a7f8c-237f-4f13-a6c8-7a50c6ce9842 tempest-VolumesSnapshotListTestJSON-1659100387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc07fdc9-5249-45b9-b457-6ecae953f979(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:05:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-417a7f8c-237f-4f13-a6c8-7a50c6ce9842 tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:23 devstack sudo[94353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 1G Jul 09 10:05:23 devstack sudo[94353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:24 devstack sudo[94353]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-417a7f8c-237f-4f13-a6c8-7a50c6ce9842 tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 1G" returned: 0 in 1.136s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-417a7f8c-237f-4f13-a6c8-7a50c6ce9842 tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:24 devstack sudo[94708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 Jul 09 10:05:24 devstack sudo[94708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:25 devstack sudo[94708]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-417a7f8c-237f-4f13-a6c8-7a50c6ce9842 tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45" returned: 0 in 0.866s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:25 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-417a7f8c-237f-4f13-a6c8-7a50c6ce9842 tempest-VolumesSnapshotListTestJSON-1659100387 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 is being set with open permissions: ugo+rw Jul 09 10:05:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-417a7f8c-237f-4f13-a6c8-7a50c6ce9842 tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:25 devstack sudo[94715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 Jul 09 10:05:25 devstack sudo[94715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:25 devstack sudo[94715]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-417a7f8c-237f-4f13-a6c8-7a50c6ce9842 tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45" returned: 0 in 0.686s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-417a7f8c-237f-4f13-a6c8-7a50c6ce9842 tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.780s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:25 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-417a7f8c-237f-4f13-a6c8-7a50c6ce9842 tempest-VolumesSnapshotListTestJSON-1659100387 None] Create snapshot completed successfully Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Flow 'volume_create_manager' (22643034-9860-4a75-8173-9b5b9d1b6205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98182403-4119-4bba-8ebe-75e57853653e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98182403-4119-4bba-8ebe-75e57853653e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1354979774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccaea084-214d-4ec3-a4ce-6f704d32a706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ced419369a064b1abc4463fe02ec7a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:05:27Z,use_quota=True,user_id='ab6f1927a17540ab838d461cd9f62398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d11e379-3ed9-4d4e-8430-91657dc84dce),volume_type_id=0d11e379-3ed9-4d4e-8430-91657dc84dce)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36c36ca-4fe2-4fce-a938-b4615ffe9ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f36c36ca-4fe2-4fce-a938-b4615ffe9ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74f7fac-c42c-4ce7-9aef-d7cf2c088093) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74f7fac-c42c-4ce7-9aef-d7cf2c088093) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccaea084-214d-4ec3-a4ce-6f704d32a706', 'volume_name': 'volume-ccaea084-214d-4ec3-a4ce-6f704d32a706', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51589a85-30a5-4f3d-838a-b4f3546a1d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51589a85-30a5-4f3d-838a-b4f3546a1d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454bc425-95ec-40d2-9fdd-e05e4718242e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:27 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Volume ccaea084-214d-4ec3-a4ce-6f704d32a706: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccaea084-214d-4ec3-a4ce-6f704d32a706', 'volume_size': 1} Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:05:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1354979774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccaea084-214d-4ec3-a4ce-6f704d32a706,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ced419369a064b1abc4463fe02ec7a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:05:27Z,use_quota=True,user_id='ab6f1927a17540ab838d461cd9f62398',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d11e379-3ed9-4d4e-8430-91657dc84dce),volume_type_id=0d11e379-3ed9-4d4e-8430-91657dc84dce)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Creating volume ccaea084-214d-4ec3-a4ce-6f704d32a706 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:05:27 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ccaea084-214d-4ec3-a4ce-6f704d32a706 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:27 devstack sudo[94718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ccaea084-214d-4ec3-a4ce-6f704d32a706 1073741824 Jul 09 10:05:27 devstack sudo[94718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6e0503c0-225d-4892-b159-d09689f840fe tempest-VolumesSnapshotListTestJSON-1659100387 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:28 devstack sudo[94718]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ccaea084-214d-4ec3-a4ce-6f704d32a706 1073741824" returned: 0 in 1.030s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ccaea084-214d-4ec3-a4ce-6f704d32a706 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:28 devstack sudo[94761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ccaea084-214d-4ec3-a4ce-6f704d32a706 Jul 09 10:05:28 devstack sudo[94761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:29 devstack sudo[94761]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ccaea084-214d-4ec3-a4ce-6f704d32a706" returned: 0 in 0.656s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] <== create_volume: return (1724ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6e0503c0-225d-4892-b159-d09689f840fe tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.685s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (454bc425-95ec-40d2-9fdd-e05e4718242e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccaea084-214d-4ec3-a4ce-6f704d32a706', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d8ea0a-7cbc-4788-876f-783817346941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-6e0503c0-225d-4892-b159-d09689f840fe tempest-VolumesSnapshotListTestJSON-1659100387 None] Creating offline snapshot ff660208-a7bd-49d4-8c51-237a84771d50 of volume fc07fdc9-5249-45b9-b457-6ecae953f979 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:05:29 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Volume volume-ccaea084-214d-4ec3-a4ce-6f704d32a706 (ccaea084-214d-4ec3-a4ce-6f704d32a706): created successfully Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21d8ea0a-7cbc-4788-876f-783817346941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Flow 'volume_create_manager' (22643034-9860-4a75-8173-9b5b9d1b6205) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[40b6b3c8-7070-489a-a8e4-9c6cb0027722]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e0503c0-225d-4892-b159-d09689f840fe tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:29 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2c0681f0-e282-45c7-ba40-b302882d231d tempest-VolumeTypesAccessTest-1189950190 None] Created volume successfully. Jul 09 10:05:29 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 Jul 09 10:05:29 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:29 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:05:29 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:29 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e0503c0-225d-4892-b159-d09689f840fe tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45" returned: 0 in 0.862s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-6e0503c0-225d-4892-b159-d09689f840fe tempest-VolumesSnapshotListTestJSON-1659100387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc07fdc9-5249-45b9-b457-6ecae953f979(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:05:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e0503c0-225d-4892-b159-d09689f840fe tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.ff660208-a7bd-49d4-8c51-237a84771d50 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:29 devstack sudo[94777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.ff660208-a7bd-49d4-8c51-237a84771d50 1G Jul 09 10:05:29 devstack sudo[94777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-7cc0162f-c03e-4088-846d-eeed9be9909a req-b1d6403d-ad2b-476e-867c-2281e92f9454 tempest-ServerActionsTestOtherA-66448965 None] Terminate volume connection completed successfully. Jul 09 10:05:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-7cc0162f-c03e-4088-846d-eeed9be9909a req-b1d6403d-ad2b-476e-867c-2281e92f9454 tempest-ServerActionsTestOtherA-66448965 None] Deleting attachment e37250a5-75be-45c5-b53a-c1b052fac653. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:05:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] Acquiring lock "cinder-ccaea084-214d-4ec3-a4ce-6f704d32a706-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:05:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] Lock "cinder-ccaea084-214d-4ec3-a4ce-6f704d32a706-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:05:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] Acquiring lock "cinder-quobyte-ccaea084-214d-4ec3-a4ce-6f704d32a706" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:05:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] Lock "cinder-quobyte-ccaea084-214d-4ec3-a4ce-6f704d32a706" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:05:30 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a359a259-1698-4317-87ed-5a4ad2ec63a6]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ccaea084-214d-4ec3-a4ce-6f704d32a706 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:30 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:30 devstack sudo[94806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ccaea084-214d-4ec3-a4ce-6f704d32a706 Jul 09 10:05:30 devstack sudo[94806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.764s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:05:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:05:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:05:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:05:31 devstack sudo[94777]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e0503c0-225d-4892-b159-d09689f840fe tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.ff660208-a7bd-49d4-8c51-237a84771d50 1G" returned: 0 in 1.038s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e0503c0-225d-4892-b159-d09689f840fe tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.ff660208-a7bd-49d4-8c51-237a84771d50 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:31 devstack sudo[94811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.ff660208-a7bd-49d4-8c51-237a84771d50 Jul 09 10:05:31 devstack sudo[94811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:31 devstack sudo[94806]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ccaea084-214d-4ec3-a4ce-6f704d32a706" returned: 0 in 0.792s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ccaea084-214d-4ec3-a4ce-6f704d32a706 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:31 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ccaea084-214d-4ec3-a4ce-6f704d32a706 Jul 09 10:05:31 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:32 devstack sudo[94811]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e0503c0-225d-4892-b159-d09689f840fe tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.ff660208-a7bd-49d4-8c51-237a84771d50" returned: 0 in 1.017s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:32 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-6e0503c0-225d-4892-b159-d09689f840fe tempest-VolumesSnapshotListTestJSON-1659100387 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.ff660208-a7bd-49d4-8c51-237a84771d50 is being set with open permissions: ugo+rw Jul 09 10:05:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e0503c0-225d-4892-b159-d09689f840fe tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.ff660208-a7bd-49d4-8c51-237a84771d50 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:32 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.ff660208-a7bd-49d4-8c51-237a84771d50 Jul 09 10:05:32 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:32 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ccaea084-214d-4ec3-a4ce-6f704d32a706" returned: 0 in 0.934s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] Lock "cinder-quobyte-ccaea084-214d-4ec3-a4ce-6f704d32a706" released by "delete_volume" :: held 1.786s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:05:32 devstack cinder-volume[87192]: WARNING cinder.quota [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-2006808591 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-2006808591, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:05:32 devstack cinder-volume[87192]: WARNING cinder.quota [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-2006808591 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-2006808591, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:05:32 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] Created reservations ['ef17f41a-6b80-4ffb-8ce0-03fdd5d64126', 'f29b0767-479d-40f3-9638-303443dda45c', '726129eb-73a0-4473-821f-d25a03a788d0', '36da72b6-7013-46b9-858a-fa32e5623697'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:05:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:05:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:05:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:32 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:05:32 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-7cc0162f-c03e-4088-846d-eeed9be9909a req-ebe08878-df77-454b-acaf-a79b12e0fbd4 tempest-ServerActionsTestOtherA-66448965 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:32 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e0503c0-225d-4892-b159-d09689f840fe tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.ff660208-a7bd-49d4-8c51-237a84771d50" returned: 0 in 0.771s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6e0503c0-225d-4892-b159-d09689f840fe tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.819s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-7cc0162f-c03e-4088-846d-eeed9be9909a req-ebe08878-df77-454b-acaf-a79b12e0fbd4 tempest-ServerActionsTestOtherA-66448965 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.053s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:32 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[12c001aa-2a9a-4efa-a625-26c168c9df0e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-7cc0162f-c03e-4088-846d-eeed9be9909a req-ebe08878-df77-454b-acaf-a79b12e0fbd4 tempest-ServerActionsTestOtherA-66448965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-106de322-0fe6-4ef7-b33c-742d7ee30850 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:32 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6e0503c0-225d-4892-b159-d09689f840fe tempest-VolumesSnapshotListTestJSON-1659100387 None] Create snapshot completed successfully Jul 09 10:05:32 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-106de322-0fe6-4ef7-b33c-742d7ee30850 Jul 09 10:05:32 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:33 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.772s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:33 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:05:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] Deleted volume successfully. Jul 09 10:05:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ad9a293c-763a-4439-b3d8-40dec066ea2f tempest-VolumeTypesAccessTest-1189950190 None] Lock "cinder-ccaea084-214d-4ec3-a4ce-6f704d32a706-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:05:33 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-7cc0162f-c03e-4088-846d-eeed9be9909a req-ebe08878-df77-454b-acaf-a79b12e0fbd4 tempest-ServerActionsTestOtherA-66448965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-106de322-0fe6-4ef7-b33c-742d7ee30850" returned: 0 in 0.976s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-7cc0162f-c03e-4088-846d-eeed9be9909a req-ebe08878-df77-454b-acaf-a79b12e0fbd4 tempest-ServerActionsTestOtherA-66448965 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-7cc0162f-c03e-4088-846d-eeed9be9909a req-ebe08878-df77-454b-acaf-a79b12e0fbd4 tempest-ServerActionsTestOtherA-66448965 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-106de322-0fe6-4ef7-b33c-742d7ee30850', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9ff9b7ce-d48d-44d3-be2b-7e7856e23282', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:05:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-7cc0162f-c03e-4088-846d-eeed9be9909a req-ebe08878-df77-454b-acaf-a79b12e0fbd4 tempest-ServerActionsTestOtherA-66448965 None] attachment_update completed successfully. Jul 09 10:05:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] Acquiring lock "cinder-ff660208-a7bd-49d4-8c51-237a84771d50-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:05:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-ff660208-a7bd-49d4-8c51-237a84771d50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:05:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] Acquiring lock "cinder-quobyte-fc07fdc9-5249-45b9-b457-6ecae953f979" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:05:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-quobyte-fc07fdc9-5249-45b9-b457-6ecae953f979" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:05:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] Acquiring lock "cinder-quobyte-ff660208-a7bd-49d4-8c51-237a84771d50" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:05:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-quobyte-ff660208-a7bd-49d4-8c51-237a84771d50" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:05:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] Deleting offline snapshot ff660208-a7bd-49d4-8c51-237a84771d50 of volume fc07fdc9-5249-45b9-b457-6ecae953f979 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:05:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] snapshot_file for this snap is: volume-fc07fdc9-5249-45b9-b457-6ecae953f979.ff660208-a7bd-49d4-8c51-237a84771d50 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:05:34 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ae5248-8e0d-403e-8671-f373d76ae453]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.ff660208-a7bd-49d4-8c51-237a84771d50 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:34 devstack sudo[94878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.ff660208-a7bd-49d4-8c51-237a84771d50 Jul 09 10:05:34 devstack sudo[94878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:35 devstack sudo[94878]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.ff660208-a7bd-49d4-8c51-237a84771d50" returned: 0 in 0.911s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc07fdc9-5249-45b9-b457-6ecae953f979(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:05:35 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a72fdf3c-d10b-4d35-8eb3-0fdbf3131627]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:35 devstack sudo[94883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 Jul 09 10:05:35 devstack sudo[94883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:36 devstack sudo[94883]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45" returned: 0 in 0.944s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc07fdc9-5249-45b9-b457-6ecae953f979(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:05:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.ff660208-a7bd-49d4-8c51-237a84771d50 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:36 devstack sudo[94893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.ff660208-a7bd-49d4-8c51-237a84771d50 Jul 09 10:05:36 devstack sudo[94893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:37 devstack sudo[94893]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.ff660208-a7bd-49d4-8c51-237a84771d50" returned: 0 in 0.925s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.ff660208-a7bd-49d4-8c51-237a84771d50 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:37 devstack sudo[94912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.ff660208-a7bd-49d4-8c51-237a84771d50 Jul 09 10:05:37 devstack sudo[94912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:37 devstack sudo[94912]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.ff660208-a7bd-49d4-8c51-237a84771d50" returned: 0 in 0.752s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-quobyte-ff660208-a7bd-49d4-8c51-237a84771d50" released by "_delete_snapshot" :: held 3.664s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:05:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-quobyte-fc07fdc9-5249-45b9-b457-6ecae953f979" released by "delete_snapshot" :: held 3.695s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:05:38 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] Created reservations ['e10349a1-35e7-4966-b630-29e4f8ca776f', 'eb1f8335-6436-4b75-9d46-265d1018f7c9', '5871d822-e630-4576-a7d7-7cd1767f0e2b', '038f58c3-9c4a-4c86-9fad-c572896f6b3e'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:05:38 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] Delete snapshot completed successfully. Jul 09 10:05:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0379c661-b6fb-4b30-9038-aa3b2a2ccf7b tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-ff660208-a7bd-49d4-8c51-237a84771d50-delete_snapshot" released by "delete_snapshot" :: held 4.026s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:05:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] Acquiring lock "cinder-d31e6626-b282-4ae0-b5d4-6a5914abef45-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:05:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-d31e6626-b282-4ae0-b5d4-6a5914abef45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:05:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] Acquiring lock "cinder-quobyte-fc07fdc9-5249-45b9-b457-6ecae953f979" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:05:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-quobyte-fc07fdc9-5249-45b9-b457-6ecae953f979" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:05:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] Acquiring lock "cinder-quobyte-d31e6626-b282-4ae0-b5d4-6a5914abef45" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:05:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-quobyte-d31e6626-b282-4ae0-b5d4-6a5914abef45" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:05:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] Deleting offline snapshot d31e6626-b282-4ae0-b5d4-6a5914abef45 of volume fc07fdc9-5249-45b9-b457-6ecae953f979 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:05:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] snapshot_file for this snap is: volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:05:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4430b9a7-e7bd-4316-be30-b9884d6acff8]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:38 devstack sudo[95004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 Jul 09 10:05:38 devstack sudo[95004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Flow 'volume_create_manager' (45f8a8fe-d8c7-4c35-be21-988ebd5111a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18518d34-9908-45ab-9e3a-35b2d2f26b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (18518d34-9908-45ab-9e3a-35b2d2f26b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-461821468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=458fef2d-856d-427a-81e5-ee2e096ac3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec38f289c25142c1a62c63608dcf0cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:05:39Z,use_quota=True,user_id='4e39e88da70a41b497347e00a5c2574c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae4f5e8-9ffe-4895-a222-7e7aa2ebf0d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bae4f5e8-9ffe-4895-a222-7e7aa2ebf0d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823c41be-ade0-4e43-918d-4f186b12c7aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (823c41be-ade0-4e43-918d-4f186b12c7aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '458fef2d-856d-427a-81e5-ee2e096ac3fa', 'volume_name': 'volume-458fef2d-856d-427a-81e5-ee2e096ac3fa', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049e1e5e-1f00-4ea9-9e81-0268d82314e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (049e1e5e-1f00-4ea9-9e81-0268d82314e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ac96d32-5b32-43e2-a4e9-7e0d80451528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:39 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Volume 458fef2d-856d-427a-81e5-ee2e096ac3fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-458fef2d-856d-427a-81e5-ee2e096ac3fa', 'volume_size': 1} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:05:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-461821468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=458fef2d-856d-427a-81e5-ee2e096ac3fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec38f289c25142c1a62c63608dcf0cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:05:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:05:39Z,use_quota=True,user_id='4e39e88da70a41b497347e00a5c2574c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Creating volume 458fef2d-856d-427a-81e5-ee2e096ac3fa {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:05:39 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-458fef2d-856d-427a-81e5-ee2e096ac3fa 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:39 devstack sudo[95007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-458fef2d-856d-427a-81e5-ee2e096ac3fa 1073741824 Jul 09 10:05:39 devstack sudo[95007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:39 devstack sudo[95004]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45" returned: 0 in 0.967s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc07fdc9-5249-45b9-b457-6ecae953f979(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd60ac8-76e2-4351-acd9-b981330a1fee]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:40 devstack sudo[95216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f Jul 09 10:05:40 devstack sudo[95216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:40 devstack sudo[95007]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-458fef2d-856d-427a-81e5-ee2e096ac3fa 1073741824" returned: 0 in 1.213s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-458fef2d-856d-427a-81e5-ee2e096ac3fa {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:40 devstack sudo[95353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-458fef2d-856d-427a-81e5-ee2e096ac3fa Jul 09 10:05:40 devstack sudo[95353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:41 devstack sudo[95216]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f" returned: 0 in 1.278s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc07fdc9-5249-45b9-b457-6ecae953f979(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:05:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:41 devstack sudo[95360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 Jul 09 10:05:41 devstack sudo[95360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:42 devstack sudo[95353]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-458fef2d-856d-427a-81e5-ee2e096ac3fa" returned: 0 in 1.334s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] <== create_volume: return (2618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:05:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.622s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ac96d32-5b32-43e2-a4e9-7e0d80451528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-458fef2d-856d-427a-81e5-ee2e096ac3fa', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9902f62a-19cd-42f7-a643-cc1ef5b88c78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:42 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Volume volume-458fef2d-856d-427a-81e5-ee2e096ac3fa (458fef2d-856d-427a-81e5-ee2e096ac3fa): created successfully Jul 09 10:05:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9902f62a-19cd-42f7-a643-cc1ef5b88c78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Flow 'volume_create_manager' (45f8a8fe-d8c7-4c35-be21-988ebd5111a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:05:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1956e1e1-d3d0-43ae-92a6-732a4569335b tempest-AttachVolumeNegativeTest-2008901733 None] Created volume successfully. Jul 09 10:05:42 devstack sudo[95360]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45" returned: 0 in 1.520s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:42 devstack sudo[95372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45 Jul 09 10:05:42 devstack sudo[95372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:43 devstack sudo[95372]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.d31e6626-b282-4ae0-b5d4-6a5914abef45" returned: 0 in 1.094s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-quobyte-d31e6626-b282-4ae0-b5d4-6a5914abef45" released by "_delete_snapshot" :: held 5.062s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:05:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-quobyte-fc07fdc9-5249-45b9-b457-6ecae953f979" released by "delete_snapshot" :: held 5.114s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:05:43 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] Created reservations ['7826a164-44cd-42f4-b8c3-13c6303b8db2', 'd5ffe960-e3cf-45a9-990d-d10979a4c1f4', 'fc9d3861-4ee2-49d1-93da-734765e0bf21', '0c73ee2c-6a33-4252-89df-8d5d371b7a6e'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:05:43 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] Delete snapshot completed successfully. Jul 09 10:05:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-73777ded-c48a-407f-946d-9531a5d33cde tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-d31e6626-b282-4ae0-b5d4-6a5914abef45-delete_snapshot" released by "delete_snapshot" :: held 5.309s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:05:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] Acquiring lock "cinder-11e892ee-52ec-40a0-a468-6bb187d0550f-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:05:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-11e892ee-52ec-40a0-a468-6bb187d0550f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:05:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] Acquiring lock "cinder-quobyte-fc07fdc9-5249-45b9-b457-6ecae953f979" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:05:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-quobyte-fc07fdc9-5249-45b9-b457-6ecae953f979" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:05:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] Acquiring lock "cinder-quobyte-11e892ee-52ec-40a0-a468-6bb187d0550f" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:05:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-quobyte-11e892ee-52ec-40a0-a468-6bb187d0550f" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:05:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] Deleting offline snapshot 11e892ee-52ec-40a0-a468-6bb187d0550f of volume fc07fdc9-5249-45b9-b457-6ecae953f979 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:05:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] snapshot_file for this snap is: volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:05:44 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e88007ad-f4c9-4faa-ad70-6ef8227f1eae]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:44 devstack sudo[95380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f Jul 09 10:05:44 devstack sudo[95380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:45 devstack sudo[95380]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f" returned: 0 in 0.907s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc07fdc9-5249-45b9-b457-6ecae953f979(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:05:45 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b5b9ec9-82fc-4ed6-baa8-b0de1957721e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:45 devstack sudo[95386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979 Jul 09 10:05:45 devstack sudo[95386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:46 devstack sudo[95386]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979" returned: 0 in 0.854s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:46 devstack sudo[95392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f Jul 09 10:05:46 devstack sudo[95392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-37796b20-d030-4098-97d4-4818021752b5 req-d4817349-bbc7-4619-9d6c-aa80a3fe9817 tempest-AttachVolumeNegativeTest-2008901733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-37796b20-d030-4098-97d4-4818021752b5 req-d4817349-bbc7-4619-9d6c-aa80a3fe9817 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:46 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f1ac18-7439-4f02-ad41-6336f1b2e0fc]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-37796b20-d030-4098-97d4-4818021752b5 req-d4817349-bbc7-4619-9d6c-aa80a3fe9817 tempest-AttachVolumeNegativeTest-2008901733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-458fef2d-856d-427a-81e5-ee2e096ac3fa {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:46 devstack sudo[95402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-458fef2d-856d-427a-81e5-ee2e096ac3fa Jul 09 10:05:46 devstack sudo[95402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:46 devstack sudo[95392]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f" returned: 0 in 0.902s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:47 devstack sudo[95408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f Jul 09 10:05:47 devstack sudo[95408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:47 devstack sudo[95402]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-37796b20-d030-4098-97d4-4818021752b5 req-d4817349-bbc7-4619-9d6c-aa80a3fe9817 tempest-AttachVolumeNegativeTest-2008901733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-458fef2d-856d-427a-81e5-ee2e096ac3fa" returned: 0 in 0.976s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-37796b20-d030-4098-97d4-4818021752b5 req-d4817349-bbc7-4619-9d6c-aa80a3fe9817 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-37796b20-d030-4098-97d4-4818021752b5 req-d4817349-bbc7-4619-9d6c-aa80a3fe9817 tempest-AttachVolumeNegativeTest-2008901733 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-458fef2d-856d-427a-81e5-ee2e096ac3fa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4986460e-296a-4fa4-a665-2334c0375db4', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:05:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-37796b20-d030-4098-97d4-4818021752b5 req-d4817349-bbc7-4619-9d6c-aa80a3fe9817 tempest-AttachVolumeNegativeTest-2008901733 None] attachment_update completed successfully. Jul 09 10:05:47 devstack sudo[95408]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979.11e892ee-52ec-40a0-a468-6bb187d0550f" returned: 0 in 0.933s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-quobyte-11e892ee-52ec-40a0-a468-6bb187d0550f" released by "_delete_snapshot" :: held 3.752s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:05:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-quobyte-fc07fdc9-5249-45b9-b457-6ecae953f979" released by "delete_snapshot" :: held 3.787s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:05:48 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] Created reservations ['b0802b36-ef54-4aa3-a2ad-439b57f6b34e', 'a2e8e7fc-e91a-4e84-957a-559a725f4f76', '8597972b-4fa9-4214-ae34-cef060baf3dd', 'dc8c6531-337a-4bd4-903e-8a3a83d25828'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:05:48 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] Delete snapshot completed successfully. Jul 09 10:05:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d997ee67-8a61-4aa3-be2e-154830a2a229 tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-11e892ee-52ec-40a0-a468-6bb187d0550f-delete_snapshot" released by "delete_snapshot" :: held 3.970s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:05:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-81aa872e-4d1e-4b40-bebb-418813f43561 tempest-VolumesSnapshotListTestJSON-1659100387 None] Acquiring lock "cinder-fc07fdc9-5249-45b9-b457-6ecae953f979-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:05:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-81aa872e-4d1e-4b40-bebb-418813f43561 tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-fc07fdc9-5249-45b9-b457-6ecae953f979-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:05:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-81aa872e-4d1e-4b40-bebb-418813f43561 tempest-VolumesSnapshotListTestJSON-1659100387 None] Acquiring lock "cinder-quobyte-fc07fdc9-5249-45b9-b457-6ecae953f979" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:05:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-81aa872e-4d1e-4b40-bebb-418813f43561 tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-quobyte-fc07fdc9-5249-45b9-b457-6ecae953f979" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:05:48 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6a52a28-7f7e-4901-a3f0-57d0b88afd9a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81aa872e-4d1e-4b40-bebb-418813f43561 tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:48 devstack sudo[95416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979 Jul 09 10:05:48 devstack sudo[95416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:49 devstack sudo[95416]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81aa872e-4d1e-4b40-bebb-418813f43561 tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979" returned: 0 in 0.822s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81aa872e-4d1e-4b40-bebb-418813f43561 tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:49 devstack sudo[95425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979 Jul 09 10:05:49 devstack sudo[95425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Flow 'volume_create_manager' (68e6c8d8-8410-4bb0-bbe1-0de6e28fffc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80953ec0-d49a-4501-a2e5-d798c579861e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80953ec0-d49a-4501-a2e5-d798c579861e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1612324420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7097af54-ce04-45e4-8456-da856edcc2a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='362bb7d439c040eb89f2e1499d8bfc51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:05:50Z,use_quota=True,user_id='7c46182c207b4bd3930de30a7b3454a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3f406f-071b-4759-9f12-5876f2cc827e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d3f406f-071b-4759-9f12-5876f2cc827e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:50 devstack sudo[95425]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd17a27-a87b-40a1-bcd3-ba843579f5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG cinder.image.glance [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Creating Keystone auth plugin from conf {{(pid=87192) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81aa872e-4d1e-4b40-bebb-418813f43561 tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-fc07fdc9-5249-45b9-b457-6ecae953f979" returned: 0 in 0.790s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-81aa872e-4d1e-4b40-bebb-418813f43561 tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-quobyte-fc07fdc9-5249-45b9-b457-6ecae953f979" released by "delete_volume" :: held 1.687s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-81aa872e-4d1e-4b40-bebb-418813f43561 tempest-VolumesSnapshotListTestJSON-1659100387 None] Created reservations ['9dda00f3-b932-45f2-9e14-714f3605833a', 'dea00833-2fd1-499b-a0d1-90ce52bf3806', '1ecdaf10-45dc-4b03-a5cc-d99672c23155', '27436a35-9d42-4cb0-a281-39d4f343976d'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-81aa872e-4d1e-4b40-bebb-418813f43561 tempest-VolumesSnapshotListTestJSON-1659100387 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-81aa872e-4d1e-4b40-bebb-418813f43561 tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-81aa872e-4d1e-4b40-bebb-418813f43561 tempest-VolumesSnapshotListTestJSON-1659100387 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-81aa872e-4d1e-4b40-bebb-418813f43561 tempest-VolumesSnapshotListTestJSON-1659100387 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-81aa872e-4d1e-4b40-bebb-418813f43561 tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81aa872e-4d1e-4b40-bebb-418813f43561 tempest-VolumesSnapshotListTestJSON-1659100387 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:50 devstack sudo[95428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:05:50 devstack sudo[95428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bd17a27-a87b-40a1-bcd3-ba843579f5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7097af54-ce04-45e4-8456-da856edcc2a1', 'volume_name': 'volume-7097af54-ce04-45e4-8456-da856edcc2a1', 'volume_size': 1, 'image_id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fbd1c6e24b394cf998d7f93c3a7d72f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'created_at': datetime.datetime(2026, 7, 9, 7, 52, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 52, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e72de809-3252-4eea-8b8e-0f2e7860adb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e72de809-3252-4eea-8b8e-0f2e7860adb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8017b5-0e6c-435c-baba-561bb349791a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:05:50 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Volume 7097af54-ce04-45e4-8456-da856edcc2a1: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7097af54-ce04-45e4-8456-da856edcc2a1', 'volume_size': 1, 'image_id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fbd1c6e24b394cf998d7f93c3a7d72f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'created_at': datetime.datetime(2026, 7, 9, 7, 52, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 52, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 10:05:50 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Trying to clone 7097af54-ce04-45e4-8456-da856edcc2a1 from image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}]). {{(pid=87192) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 10:05:51 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_c4_ilqp7devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 10:05:51 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Image download 20.69 MB at 20.69 MB/s Jul 09 10:05:51 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[57bee651-dcbe-440f-99f0-11e6f3ba89e9]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_c4_ilqp7devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:51 devstack sudo[95428]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-81aa872e-4d1e-4b40-bebb-418813f43561 tempest-VolumesSnapshotListTestJSON-1659100387 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.928s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:51 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-81aa872e-4d1e-4b40-bebb-418813f43561 tempest-VolumesSnapshotListTestJSON-1659100387 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:05:51 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-81aa872e-4d1e-4b40-bebb-418813f43561 tempest-VolumesSnapshotListTestJSON-1659100387 None] Deleted volume successfully. Jul 09 10:05:51 devstack sudo[95432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_c4_ilqp7devstack@QuobyteHD Jul 09 10:05:51 devstack sudo[95432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-81aa872e-4d1e-4b40-bebb-418813f43561 tempest-VolumesSnapshotListTestJSON-1659100387 None] Lock "cinder-fc07fdc9-5249-45b9-b457-6ecae953f979-delete_volume" released by "delete_volume" :: held 2.892s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:05:52 devstack sudo[95432]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_c4_ilqp7devstack@QuobyteHD" returned: 0 in 0.987s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:52 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Temporary image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 is fetched for user 7c46182c207b4bd3930de30a7b3454a1. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 10:05:52 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0113e9bd-1cbf-42e7-99f6-41eebc40ff65]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_c4_ilqp7devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:52 devstack sudo[95438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_c4_ilqp7devstack@QuobyteHD Jul 09 10:05:52 devstack sudo[95438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:53 devstack sudo[95438]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_c4_ilqp7devstack@QuobyteHD" returned: 0 in 0.885s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:05:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1612324420',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7097af54-ce04-45e4-8456-da856edcc2a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='362bb7d439c040eb89f2e1499d8bfc51',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:05:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:05:50Z,use_quota=True,user_id='7c46182c207b4bd3930de30a7b3454a1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:05:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Creating volume 7097af54-ce04-45e4-8456-da856edcc2a1 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:05:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:05:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:05:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:05:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:05:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:05:53 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:05:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:53 devstack sudo[95443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 1073741824 Jul 09 10:05:53 devstack sudo[95443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:54 devstack sudo[95443]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 1073741824" returned: 0 in 1.029s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:54 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 Jul 09 10:05:54 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:55 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1" returned: 0 in 0.810s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] <== create_volume: return (1891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:05:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.895s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:05:55 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Attempting download of fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}])) to volume 7097af54-ce04-45e4-8456-da856edcc2a1. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 10:05:55 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[887721d5-27ed-429d-a6ab-43e0815aaa94]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0m6hxyiu {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:55 devstack sudo[95480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0m6hxyiu Jul 09 10:05:55 devstack sudo[95480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:56 devstack sudo[95480]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0m6hxyiu" returned: 0 in 0.841s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0m6hxyiu {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:56 devstack sudo[95487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0m6hxyiu Jul 09 10:05:56 devstack sudo[95487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:56 devstack sudo[95487]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0m6hxyiu" returned: 1 in 0.788s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0m6hxyiu' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:05:56 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f239aed1-32a6-4ac0-8890-4020210e5332]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:05:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_c4_ilqp7devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:56 devstack sudo[95492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_c4_ilqp7devstack@QuobyteHD Jul 09 10:05:56 devstack sudo[95492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:57 devstack sudo[95492]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_c4_ilqp7devstack@QuobyteHD" returned: 0 in 0.765s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:57 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 was qcow2, converting to raw {{(pid=87192) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 10:05:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_c4_ilqp7devstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:57 devstack sudo[95522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_c4_ilqp7devstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 Jul 09 10:05:57 devstack sudo[95522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:05:59 devstack sudo[95522]: pam_unix(sudo:session): session closed for user root Jul 09 10:05:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_c4_ilqp7devstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1" returned: 0 in 2.199s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:05:59 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_c4_ilqp7devstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:05:59 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Converted 112.00 MB image at 50.90 MB/s Jul 09 10:05:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:05:59 devstack sudo[95531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 1G Jul 09 10:05:59 devstack sudo[95531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:00 devstack sudo[95531]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 1G" returned: 0 in 0.791s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:00 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c3857be-4862-4f31-b13d-df0a9514161c]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:06:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:00 devstack sudo[95536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 Jul 09 10:06:00 devstack sudo[95536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:01 devstack sudo[95536]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1" returned: 0 in 0.935s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:01 devstack sudo[95540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 Jul 09 10:06:01 devstack sudo[95540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:02 devstack sudo[95540]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1" returned: 1 in 0.966s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:06:02 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Downloaded image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}])) to volume 7097af54-ce04-45e4-8456-da856edcc2a1 successfully. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 10:06:02 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Temporary image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 for user 7c46182c207b4bd3930de30a7b3454a1 is deleted. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 10:06:02 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Marking volume 7097af54-ce04-45e4-8456-da856edcc2a1 as bootable. {{(pid=87192) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 10:06:02 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=88,cinder:SELECT=94,cinder:INSERT=25,cinder:DELETE=8 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:06:02 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Copying metadata from image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 to 7097af54-ce04-45e4-8456-da856edcc2a1. {{(pid=87192) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 10:06:02 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Creating volume glance metadata for volume 7097af54-ce04-45e4-8456-da856edcc2a1 backed by image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87192) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 10:06:02 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=91,cinder:INSERT=28,cinder:UPDATE=89,cinder:DELETE=6 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:06:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c8017b5-0e6c-435c-baba-561bb349791a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7097af54-ce04-45e4-8456-da856edcc2a1', 'volume_size': 1, 'image_id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fbd1c6e24b394cf998d7f93c3a7d72f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'created_at': datetime.datetime(2026, 7, 9, 7, 52, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 52, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83b6aee-dd43-41e9-937c-7909c25c7c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:02 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Volume volume-7097af54-ce04-45e4-8456-da856edcc2a1 (7097af54-ce04-45e4-8456-da856edcc2a1): created successfully Jul 09 10:06:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f83b6aee-dd43-41e9-937c-7909c25c7c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Flow 'volume_create_manager' (68e6c8d8-8410-4bb0-bbe1-0de6e28fffc0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:06:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8631902c-99f4-48e5-8557-07574d9c8878 tempest-VolumesImageMetadata-959589525 None] Created volume successfully. Jul 09 10:06:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] Acquiring lock "cinder-7097af54-ce04-45e4-8456-da856edcc2a1-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:06:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] Lock "cinder-7097af54-ce04-45e4-8456-da856edcc2a1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:06:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] Acquiring lock "cinder-quobyte-7097af54-ce04-45e4-8456-da856edcc2a1" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:06:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] Lock "cinder-quobyte-7097af54-ce04-45e4-8456-da856edcc2a1" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:06:03 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b4aa37-8915-468e-a24b-b16899139f7a]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:06:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:04 devstack sudo[95564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 Jul 09 10:06:04 devstack sudo[95564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:05 devstack sudo[95564]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1" returned: 0 in 1.097s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:05 devstack sudo[95570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 Jul 09 10:06:05 devstack sudo[95570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:06 devstack sudo[95570]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1" returned: 1 in 0.977s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:06:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:06 devstack sudo[95577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1 Jul 09 10:06:06 devstack sudo[95577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:07 devstack sudo[95577]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7097af54-ce04-45e4-8456-da856edcc2a1" returned: 0 in 1.018s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] Lock "cinder-quobyte-7097af54-ce04-45e4-8456-da856edcc2a1" released by "delete_volume" :: held 3.193s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:06:07 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] Created reservations ['e23ca3f5-0ecf-4630-825d-8591042431a1', '16c8c830-5492-4788-aa2a-bda2364d5581', 'fa01b5f0-245d-4d3a-851e-506cdebb5836', 'a1fb7125-ad6c-4778-94a0-ea3364b2fc77'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:06:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:06:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:06:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:06:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:06:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:07 devstack sudo[95604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:06:07 devstack sudo[95604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:08 devstack sudo[95604]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.794s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:08 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:06:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] Deleted volume successfully. Jul 09 10:06:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3b3bec32-0cea-4cad-a408-0ad49adcbdd8 tempest-VolumesImageMetadata-959589525 None] Lock "cinder-7097af54-ce04-45e4-8456-da856edcc2a1-delete_volume" released by "delete_volume" :: held 4.343s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:06:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-94607108-9058-4bf6-b5cc-a5e33b1368ed req-c643fea5-13b3-4f95-a785-818530e2e16d tempest-ServerActionsTestOtherA-66448965 None] Terminate volume connection completed successfully. Jul 09 10:06:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-94607108-9058-4bf6-b5cc-a5e33b1368ed req-c643fea5-13b3-4f95-a785-818530e2e16d tempest-ServerActionsTestOtherA-66448965 None] Deleting attachment 9ff9b7ce-d48d-44d3-be2b-7e7856e23282. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:06:18 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=10,cinder:INSERT=4,cinder:UPDATE=12,cinder:DELETE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:06:18 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=14,cinder:INSERT=12,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Flow 'volume_create_manager' (454fabc5-5944-4601-91ba-ecb28689e363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1be380-7200-4fbd-9fcd-1e083be20099) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb1be380-7200-4fbd-9fcd-1e083be20099) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-315765204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9487f6fc-1879-4d5e-9fa3-1d11e04b9ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6f3db5cfb94e74af12948cab41da55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:06:23Z,use_quota=True,user_id='e8915df5e25b4db98308e45653b0bf57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ad4f2c-7362-487e-9172-ad52573c7a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6ad4f2c-7362-487e-9172-ad52573c7a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435bbd3f-9360-4e35-ac55-1a82820a2391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (435bbd3f-9360-4e35-ac55-1a82820a2391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9487f6fc-1879-4d5e-9fa3-1d11e04b9ede', 'volume_name': 'volume-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a3a679-a863-4606-a92b-212f3b8632b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2a3a679-a863-4606-a92b-212f3b8632b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d503a4c-c6cb-4795-8a76-7593787adf3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:23 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Volume 9487f6fc-1879-4d5e-9fa3-1d11e04b9ede: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede', 'volume_size': 1} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:06:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-315765204',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9487f6fc-1879-4d5e-9fa3-1d11e04b9ede,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7c6f3db5cfb94e74af12948cab41da55',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:06:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:06:23Z,use_quota=True,user_id='e8915df5e25b4db98308e45653b0bf57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Creating volume 9487f6fc-1879-4d5e-9fa3-1d11e04b9ede {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:06:23 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:06:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:23 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede 1073741824 Jul 09 10:06:23 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Flow 'volume_create_manager' (ca420157-fb4e-43de-bd02-82084ffa33b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db1f909-fc04-43bd-9ac3-69bb645ea0f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1db1f909-fc04-43bd-9ac3-69bb645ea0f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1932732376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=702c3c2e-9669-4ec8-8131-7957b3e47ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875c57d83f50436c8954f9bdea4d7657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:06:24Z,use_quota=True,user_id='55ceeecab8564cb784913b1b79eee80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc87b5e-4806-4863-b2c8-1ceaad0191c4),volume_type_id=edc87b5e-4806-4863-b2c8-1ceaad0191c4)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31f6b0d-9afc-482a-8dd2-307e5eea0e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d31f6b0d-9afc-482a-8dd2-307e5eea0e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9256f362-c5ea-4d98-8756-ea93b04f6582) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9256f362-c5ea-4d98-8756-ea93b04f6582) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '702c3c2e-9669-4ec8-8131-7957b3e47ec0', 'volume_name': 'volume-702c3c2e-9669-4ec8-8131-7957b3e47ec0', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33153dfc-91d9-4141-8e55-2ec2054eb6aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33153dfc-91d9-4141-8e55-2ec2054eb6aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee81adf3-7cb8-4110-9c9b-9af21317cb68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:24 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Volume 702c3c2e-9669-4ec8-8131-7957b3e47ec0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-702c3c2e-9669-4ec8-8131-7957b3e47ec0', 'volume_size': 1} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-50ef009b-5c09-4564-9f80-55c6dcbe75d0 tempest-ServerActionsTestOtherA-66448965 None] Acquiring lock "cinder-106de322-0fe6-4ef7-b33c-742d7ee30850-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-50ef009b-5c09-4564-9f80-55c6dcbe75d0 tempest-ServerActionsTestOtherA-66448965 None] Lock "cinder-106de322-0fe6-4ef7-b33c-742d7ee30850-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-50ef009b-5c09-4564-9f80-55c6dcbe75d0 tempest-ServerActionsTestOtherA-66448965 None] Acquiring lock "cinder-quobyte-106de322-0fe6-4ef7-b33c-742d7ee30850" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-50ef009b-5c09-4564-9f80-55c6dcbe75d0 tempest-ServerActionsTestOtherA-66448965 None] Lock "cinder-quobyte-106de322-0fe6-4ef7-b33c-742d7ee30850" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[37ca995b-2639-4e2e-a13e-78d9061beafb]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-50ef009b-5c09-4564-9f80-55c6dcbe75d0 tempest-ServerActionsTestOtherA-66448965 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-106de322-0fe6-4ef7-b33c-742d7ee30850 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:24 devstack sudo[95700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-106de322-0fe6-4ef7-b33c-742d7ee30850 Jul 09 10:06:24 devstack sudo[95700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Flow 'volume_create_manager' (b54871a6-783a-41bc-b847-708cc87f076a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de25c0cd-5ac5-4c88-970d-06a331d615e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de25c0cd-5ac5-4c88-970d-06a331d615e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-877054155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c90d3e-889b-4d38-b527-aa1717226b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875c57d83f50436c8954f9bdea4d7657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:06:24Z,use_quota=True,user_id='55ceeecab8564cb784913b1b79eee80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72426a97-ff67-4ad2-a9a6-f2497b242877),volume_type_id=72426a97-ff67-4ad2-a9a6-f2497b242877)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db24358-f65f-43b3-8a9d-b4519afae9f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0db24358-f65f-43b3-8a9d-b4519afae9f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab559fb-0cc3-47bd-9052-2726780a359c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ab559fb-0cc3-47bd-9052-2726780a359c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96c90d3e-889b-4d38-b527-aa1717226b29', 'volume_name': 'volume-96c90d3e-889b-4d38-b527-aa1717226b29', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095f2123-c888-4e39-9587-d3003cd08f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (095f2123-c888-4e39-9587-d3003cd08f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f03492-3fa8-4090-9592-603574ca001c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:24 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Volume 96c90d3e-889b-4d38-b527-aa1717226b29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96c90d3e-889b-4d38-b527-aa1717226b29', 'volume_size': 1} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:06:24 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede 1073741824" returned: 0 in 1.220s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:24 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede Jul 09 10:06:24 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:25 devstack sudo[95700]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-50ef009b-5c09-4564-9f80-55c6dcbe75d0 tempest-ServerActionsTestOtherA-66448965 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-106de322-0fe6-4ef7-b33c-742d7ee30850" returned: 0 in 0.968s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-50ef009b-5c09-4564-9f80-55c6dcbe75d0 tempest-ServerActionsTestOtherA-66448965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-106de322-0fe6-4ef7-b33c-742d7ee30850 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:25 devstack sudo[95745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-106de322-0fe6-4ef7-b33c-742d7ee30850 Jul 09 10:06:25 devstack sudo[95745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Flow 'volume_create_manager' (a244605f-75f6-417d-b8a1-7641293de495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2959f38-1bc5-44de-9d7f-4a9ed8cf9709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a2959f38-1bc5-44de-9d7f-4a9ed8cf9709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-380882308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aea5e97-4659-4964-a73c-9f80963e7640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875c57d83f50436c8954f9bdea4d7657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:06:25Z,use_quota=True,user_id='55ceeecab8564cb784913b1b79eee80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08958908-f499-4f79-9dd8-2afe4c3684a1),volume_type_id=08958908-f499-4f79-9dd8-2afe4c3684a1)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de81c51f-21fc-4111-9eda-813ee8380849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de81c51f-21fc-4111-9eda-813ee8380849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580b149a-1988-4bb2-aa49-8ad67e7447ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.image.glance [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Creating Keystone auth plugin from conf {{(pid=87192) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 10:06:25 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede" returned: 0 in 0.775s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] <== create_volume: return (2036ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.039s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.471s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1932732376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=702c3c2e-9669-4ec8-8131-7957b3e47ec0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875c57d83f50436c8954f9bdea4d7657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:06:24Z,use_quota=True,user_id='55ceeecab8564cb784913b1b79eee80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(edc87b5e-4806-4863-b2c8-1ceaad0191c4),volume_type_id=edc87b5e-4806-4863-b2c8-1ceaad0191c4)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Creating volume 702c3c2e-9669-4ec8-8131-7957b3e47ec0 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:06:25 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-702c3c2e-9669-4ec8-8131-7957b3e47ec0 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:25 devstack sudo[95748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-702c3c2e-9669-4ec8-8131-7957b3e47ec0 1073741824 Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d503a4c-c6cb-4795-8a76-7593787adf3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:25 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5858251-0610-4de3-a5fd-4bf973fd8f41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:25 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Volume volume-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede (9487f6fc-1879-4d5e-9fa3-1d11e04b9ede): created successfully Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5858251-0610-4de3-a5fd-4bf973fd8f41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Flow 'volume_create_manager' (454fabc5-5944-4601-91ba-ecb28689e363) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:06:25 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e6b5c0f5-d3d0-4b20-b562-9b79f3bd467a tempest-AbsoluteLimitsTests-659977827 None] Created volume successfully. Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (580b149a-1988-4bb2-aa49-8ad67e7447ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6aea5e97-4659-4964-a73c-9f80963e7640', 'volume_name': 'volume-6aea5e97-4659-4964-a73c-9f80963e7640', 'volume_size': 1, 'image_id': '8d0ac335-5303-45b7-a3b1-dafd02a5ccc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d0ac335-5303-45b7-a3b1-dafd02a5ccc9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1174457029', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '875c57d83f50436c8954f9bdea4d7657', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d0ac335-5303-45b7-a3b1-dafd02a5ccc9', 'created_at': datetime.datetime(2026, 7, 9, 8, 6, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 8, 6, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d0ac335-5303-45b7-a3b1-dafd02a5ccc9/file', 'properties': {}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (945277a6-e883-4924-9bf5-e19d20d59fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (945277a6-e883-4924-9bf5-e19d20d59fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3347c8-c6c3-450f-94a2-42ebe8a5629e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:25 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Volume 6aea5e97-4659-4964-a73c-9f80963e7640: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6aea5e97-4659-4964-a73c-9f80963e7640', 'volume_size': 1, 'image_id': '8d0ac335-5303-45b7-a3b1-dafd02a5ccc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d0ac335-5303-45b7-a3b1-dafd02a5ccc9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1174457029', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '875c57d83f50436c8954f9bdea4d7657', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d0ac335-5303-45b7-a3b1-dafd02a5ccc9', 'created_at': datetime.datetime(2026, 7, 9, 8, 6, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 8, 6, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d0ac335-5303-45b7-a3b1-dafd02a5ccc9/file', 'properties': {}}, 'image_service': } Jul 09 10:06:25 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Trying to clone 6aea5e97-4659-4964-a73c-9f80963e7640 from image 8d0ac335-5303-45b7-a3b1-dafd02a5ccc9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/8d0ac335-5303-45b7-a3b1-dafd02a5ccc9', 'metadata': {}}]). {{(pid=87192) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 10:06:26 devstack sudo[95745]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-50ef009b-5c09-4564-9f80-55c6dcbe75d0 tempest-ServerActionsTestOtherA-66448965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-106de322-0fe6-4ef7-b33c-742d7ee30850" returned: 0 in 0.800s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-50ef009b-5c09-4564-9f80-55c6dcbe75d0 tempest-ServerActionsTestOtherA-66448965 None] Lock "cinder-quobyte-106de322-0fe6-4ef7-b33c-742d7ee30850" released by "delete_volume" :: held 1.819s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:06:26 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-50ef009b-5c09-4564-9f80-55c6dcbe75d0 tempest-ServerActionsTestOtherA-66448965 None] Created reservations ['e4a9b284-9a70-422d-9bf6-d1ce5eed5c1f', 'ff3425db-3c92-422a-b466-fac6feb98ff2', '9ca0b38d-4747-4279-a755-c9ddf5504909', '9e496707-30c6-4a02-a86a-af6992f163fd'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:06:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-50ef009b-5c09-4564-9f80-55c6dcbe75d0 tempest-ServerActionsTestOtherA-66448965 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:06:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-50ef009b-5c09-4564-9f80-55c6dcbe75d0 tempest-ServerActionsTestOtherA-66448965 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:06:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-50ef009b-5c09-4564-9f80-55c6dcbe75d0 tempest-ServerActionsTestOtherA-66448965 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:06:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-50ef009b-5c09-4564-9f80-55c6dcbe75d0 tempest-ServerActionsTestOtherA-66448965 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:06:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-50ef009b-5c09-4564-9f80-55c6dcbe75d0 tempest-ServerActionsTestOtherA-66448965 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:06:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-50ef009b-5c09-4564-9f80-55c6dcbe75d0 tempest-ServerActionsTestOtherA-66448965 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:26 devstack sudo[95751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:06:26 devstack sudo[95751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:26 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-702c3c2e-9669-4ec8-8131-7957b3e47ec0 1073741824" returned: 0 in 1.013s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-702c3c2e-9669-4ec8-8131-7957b3e47ec0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:26 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-702c3c2e-9669-4ec8-8131-7957b3e47ec0 Jul 09 10:06:26 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2a5cb375-7912-45bf-8ed2-a82cbe30ef88 tempest-AbsoluteLimitsTests-659977827 None] Acquiring lock "cinder-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:06:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2a5cb375-7912-45bf-8ed2-a82cbe30ef88 tempest-AbsoluteLimitsTests-659977827 None] Lock "cinder-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2a5cb375-7912-45bf-8ed2-a82cbe30ef88 tempest-AbsoluteLimitsTests-659977827 None] Acquiring lock "cinder-quobyte-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2a5cb375-7912-45bf-8ed2-a82cbe30ef88 tempest-AbsoluteLimitsTests-659977827 None] Lock "cinder-quobyte-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede" acquired by "delete_volume" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[578464d6-9bef-4822-b634-3179c920b433]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2a5cb375-7912-45bf-8ed2-a82cbe30ef88 tempest-AbsoluteLimitsTests-659977827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:27 devstack sudo[95751]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-50ef009b-5c09-4564-9f80-55c6dcbe75d0 tempest-ServerActionsTestOtherA-66448965 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.901s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-50ef009b-5c09-4564-9f80-55c6dcbe75d0 tempest-ServerActionsTestOtherA-66448965 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:06:27 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-50ef009b-5c09-4564-9f80-55c6dcbe75d0 tempest-ServerActionsTestOtherA-66448965 None] Deleted volume successfully. Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-50ef009b-5c09-4564-9f80-55c6dcbe75d0 tempest-ServerActionsTestOtherA-66448965 None] Lock "cinder-106de322-0fe6-4ef7-b33c-742d7ee30850-delete_volume" released by "delete_volume" :: held 2.958s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:06:27 devstack sudo[95761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede Jul 09 10:06:27 devstack sudo[95761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:27 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-702c3c2e-9669-4ec8-8131-7957b3e47ec0" returned: 0 in 0.841s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] <== create_volume: return (1911ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.914s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.740s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:06:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-877054155',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96c90d3e-889b-4d38-b527-aa1717226b29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875c57d83f50436c8954f9bdea4d7657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:06:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:06:24Z,use_quota=True,user_id='55ceeecab8564cb784913b1b79eee80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(72426a97-ff67-4ad2-a9a6-f2497b242877),volume_type_id=72426a97-ff67-4ad2-a9a6-f2497b242877)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Creating volume 96c90d3e-889b-4d38-b527-aa1717226b29 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:06:27 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-96c90d3e-889b-4d38-b527-aa1717226b29 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:27 devstack sudo[95765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-96c90d3e-889b-4d38-b527-aa1717226b29 1073741824 Jul 09 10:06:27 devstack sudo[95765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee81adf3-7cb8-4110-9c9b-9af21317cb68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-702c3c2e-9669-4ec8-8131-7957b3e47ec0', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28194de4-2abf-46fa-a3bd-a77d26a50061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:27 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Volume volume-702c3c2e-9669-4ec8-8131-7957b3e47ec0 (702c3c2e-9669-4ec8-8131-7957b3e47ec0): created successfully Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28194de4-2abf-46fa-a3bd-a77d26a50061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Flow 'volume_create_manager' (ca420157-fb4e-43de-bd02-82084ffa33b9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:06:27 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-479e32f4-b5bf-4a0a-b800-ff4249c22e98 tempest-TestInstancesWithCinderVolumes-144069202 None] Created volume successfully. Jul 09 10:06:27 devstack sudo[95761]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2a5cb375-7912-45bf-8ed2-a82cbe30ef88 tempest-AbsoluteLimitsTests-659977827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede" returned: 0 in 0.921s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2a5cb375-7912-45bf-8ed2-a82cbe30ef88 tempest-AbsoluteLimitsTests-659977827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:28 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede Jul 09 10:06:28 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:28 devstack sudo[95765]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-96c90d3e-889b-4d38-b527-aa1717226b29 1073741824" returned: 0 in 1.350s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-96c90d3e-889b-4d38-b527-aa1717226b29 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:29 devstack sudo[95800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-96c90d3e-889b-4d38-b527-aa1717226b29 Jul 09 10:06:29 devstack sudo[95800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:29 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2a5cb375-7912-45bf-8ed2-a82cbe30ef88 tempest-AbsoluteLimitsTests-659977827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede" returned: 0 in 1.205s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2a5cb375-7912-45bf-8ed2-a82cbe30ef88 tempest-AbsoluteLimitsTests-659977827 None] Lock "cinder-quobyte-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede" released by "delete_volume" :: held 2.208s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-2a5cb375-7912-45bf-8ed2-a82cbe30ef88 tempest-AbsoluteLimitsTests-659977827 None] Created reservations ['f3b57d9e-0d8f-46c3-8374-db7d94506683', '55117786-ec80-4718-9c7e-b342c105a394', '8820437d-c9c4-46f0-9fb6-72a6ba8605b9', 'b956f5fe-ef79-417f-99cd-68ca4b6f7fef'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2a5cb375-7912-45bf-8ed2-a82cbe30ef88 tempest-AbsoluteLimitsTests-659977827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2a5cb375-7912-45bf-8ed2-a82cbe30ef88 tempest-AbsoluteLimitsTests-659977827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2a5cb375-7912-45bf-8ed2-a82cbe30ef88 tempest-AbsoluteLimitsTests-659977827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2a5cb375-7912-45bf-8ed2-a82cbe30ef88 tempest-AbsoluteLimitsTests-659977827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2a5cb375-7912-45bf-8ed2-a82cbe30ef88 tempest-AbsoluteLimitsTests-659977827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2a5cb375-7912-45bf-8ed2-a82cbe30ef88 tempest-AbsoluteLimitsTests-659977827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:29 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:06:29 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:29 devstack sudo[95806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:06:29 devstack sudo[95806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:29 devstack sudo[95800]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-96c90d3e-889b-4d38-b527-aa1717226b29" returned: 0 in 0.942s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] <== create_volume: return (2371ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.374s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86f03492-3fa8-4090-9592-603574ca001c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96c90d3e-889b-4d38-b527-aa1717226b29', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751b6e69-21ae-4d5f-b39d-0173cdb9e9c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:29 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Volume volume-96c90d3e-889b-4d38-b527-aa1717226b29 (96c90d3e-889b-4d38-b527-aa1717226b29): created successfully Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (751b6e69-21ae-4d5f-b39d-0173cdb9e9c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Flow 'volume_create_manager' (b54871a6-783a-41bc-b847-708cc87f076a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:06:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c78f62c8-c966-4a2a-86a2-34d819456790 tempest-TestInstancesWithCinderVolumes-144069202 None] Created volume successfully. Jul 09 10:06:30 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2a5cb375-7912-45bf-8ed2-a82cbe30ef88 tempest-AbsoluteLimitsTests-659977827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.154s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-2a5cb375-7912-45bf-8ed2-a82cbe30ef88 tempest-AbsoluteLimitsTests-659977827 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:06:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2a5cb375-7912-45bf-8ed2-a82cbe30ef88 tempest-AbsoluteLimitsTests-659977827 None] Deleted volume successfully. Jul 09 10:06:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2a5cb375-7912-45bf-8ed2-a82cbe30ef88 tempest-AbsoluteLimitsTests-659977827 None] Lock "cinder-9487f6fc-1879-4d5e-9fa3-1d11e04b9ede-delete_volume" released by "delete_volume" :: held 3.734s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:06:30 devstack sudo[95806]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.186s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:06:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:06:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:06:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:06:31 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_ptjombb0devstack@QuobyteHD, size 20.69 MB, duration 5.37 sec {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 10:06:31 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Image download 20.69 MB at 3.85 MB/s Jul 09 10:06:31 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fad3b54c-0f4b-4c61-a2b2-9cbf230ab295]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:06:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_ptjombb0devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:31 devstack sudo[95812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_ptjombb0devstack@QuobyteHD Jul 09 10:06:31 devstack sudo[95812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:32 devstack sudo[95812]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_ptjombb0devstack@QuobyteHD" returned: 0 in 0.794s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:32 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Temporary image 8d0ac335-5303-45b7-a3b1-dafd02a5ccc9 is fetched for user 55ceeecab8564cb784913b1b79eee80a. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 10:06:32 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[45c84250-c89e-4316-b025-2b3a3b38dd61]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:06:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_ptjombb0devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:32 devstack sudo[95818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_ptjombb0devstack@QuobyteHD Jul 09 10:06:32 devstack sudo[95818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:32 devstack sudo[95818]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_ptjombb0devstack@QuobyteHD" returned: 0 in 0.809s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:06:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:06:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:06:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-380882308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6aea5e97-4659-4964-a73c-9f80963e7640,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='875c57d83f50436c8954f9bdea4d7657',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:06:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:06:25Z,use_quota=True,user_id='55ceeecab8564cb784913b1b79eee80a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(08958908-f499-4f79-9dd8-2afe4c3684a1),volume_type_id=08958908-f499-4f79-9dd8-2afe4c3684a1)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:06:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Creating volume 6aea5e97-4659-4964-a73c-9f80963e7640 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:06:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:06:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:06:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:06:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:06:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:06:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:06:32 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:06:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:32 devstack sudo[95835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 1073741824 Jul 09 10:06:32 devstack sudo[95835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:33 devstack sudo[95835]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 1073741824" returned: 0 in 0.910s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:33 devstack sudo[95843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 Jul 09 10:06:33 devstack sudo[95843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:34 devstack sudo[95843]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640" returned: 0 in 0.825s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] <== create_volume: return (1775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:06:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.781s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:06:34 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Attempting download of 8d0ac335-5303-45b7-a3b1-dafd02a5ccc9 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d0ac335-5303-45b7-a3b1-dafd02a5ccc9', 'metadata': {}}])) to volume 6aea5e97-4659-4964-a73c-9f80963e7640. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 10:06:34 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff19511-d709-4f99-b476-329d4bb08ac8]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:06:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_v5xvbrpg {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:35 devstack sudo[95849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_v5xvbrpg Jul 09 10:06:35 devstack sudo[95849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Flow 'volume_create_manager' (8d6f1992-f483-438d-b1e1-b9ca60c630c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8dc7f3-2996-4491-87f6-3d2c52f6deb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f8dc7f3-2996-4491-87f6-3d2c52f6deb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1410496377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0ba8b8-8078-4b9d-bad0-abafe855691a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cf8928368346569fa90b63ece33ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:06:35Z,use_quota=True,user_id='1c1b830a0e8649808b2bbf8f0f7ee8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da46b45-1431-4098-ad8b-599ed8625b3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7da46b45-1431-4098-ad8b-599ed8625b3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44c5c9f-c855-4370-900b-bcce0462abe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44c5c9f-c855-4370-900b-bcce0462abe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e0ba8b8-8078-4b9d-bad0-abafe855691a', 'volume_name': 'volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffd76e5-9c8f-4d8e-a32c-28ed7f6faf9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ffd76e5-9c8f-4d8e-a32c-28ed7f6faf9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ddbe153-e3cd-4d23-a3bf-d1b2f252bac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:35 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Volume 5e0ba8b8-8078-4b9d-bad0-abafe855691a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a', 'volume_size': 1} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:06:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1410496377',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5e0ba8b8-8078-4b9d-bad0-abafe855691a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cf8928368346569fa90b63ece33ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:06:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:06:35Z,use_quota=True,user_id='1c1b830a0e8649808b2bbf8f0f7ee8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Creating volume 5e0ba8b8-8078-4b9d-bad0-abafe855691a {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:06:35 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:35 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a 1073741824 Jul 09 10:06:35 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:35 devstack sudo[95849]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_v5xvbrpg" returned: 0 in 0.916s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_v5xvbrpg {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:35 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_v5xvbrpg Jul 09 10:06:35 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:36 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a 1073741824" returned: 0 in 1.028s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:36 devstack sudo[95868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a Jul 09 10:06:36 devstack sudo[95868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:36 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_v5xvbrpg" returned: 1 in 0.817s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_v5xvbrpg' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:06:36 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ed6093c-8fc0-40a1-947a-9397c0ff4ac9]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:06:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_ptjombb0devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:36 devstack sudo[95870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_ptjombb0devstack@QuobyteHD Jul 09 10:06:36 devstack sudo[95870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:37 devstack sudo[95868]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a" returned: 0 in 1.004s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] <== create_volume: return (2094ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:06:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:06:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ddbe153-e3cd-4d23-a3bf-d1b2f252bac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dcf4f67-02f6-4bf7-8910-fcb2b3715791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:37 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Volume volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a (5e0ba8b8-8078-4b9d-bad0-abafe855691a): created successfully Jul 09 10:06:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2dcf4f67-02f6-4bf7-8910-fcb2b3715791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Flow 'volume_create_manager' (8d6f1992-f483-438d-b1e1-b9ca60c630c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:06:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-afd3f704-0b4d-4558-9aa1-cc184dd0eaeb tempest-VolumesCloneTest-5161880 None] Created volume successfully. Jul 09 10:06:37 devstack sudo[95870]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_ptjombb0devstack@QuobyteHD" returned: 0 in 1.127s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:37 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] 8d0ac335-5303-45b7-a3b1-dafd02a5ccc9 was qcow2, converting to raw {{(pid=87192) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 10:06:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_ptjombb0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:37 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_ptjombb0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 Jul 09 10:06:37 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:39 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:06:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Flow 'volume_create_manager' (8056e488-2b9a-4e83-a47f-f9bd8f190ed8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:06:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d77136-ce63-452c-9dec-89b0237813c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d77136-ce63-452c-9dec-89b0237813c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:06:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1152285068',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='19cf8928368346569fa90b63ece33ace',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:06:39Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=5e0ba8b8-8078-4b9d-bad0-abafe855691a,status='creating',terminated_at=None,updated_at=2026-07-09T08:06:39Z,use_quota=True,user_id='1c1b830a0e8649808b2bbf8f0f7ee8f7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caebf177-af65-4268-9237-d2b7aa5cce27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caebf177-af65-4268-9237-d2b7aa5cce27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00be2f4-2109-4f33-bcad-26941e99582d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c00be2f4-2109-4f33-bcad-26941e99582d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4', 'volume_name': 'volume-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4', 'volume_size': 2, 'source_volid': '5e0ba8b8-8078-4b9d-bad0-abafe855691a', 'source_volstatus': 'available'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02bef642-1c96-4a7b-b0c9-77c87b3d2217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02bef642-1c96-4a7b-b0c9-77c87b3d2217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb46b03-6911-4138-9cbe-6d3a92390af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:39 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Volume b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4', 'volume_size': 2, 'source_volid': '5e0ba8b8-8078-4b9d-bad0-abafe855691a', 'source_volstatus': 'available'} Jul 09 10:06:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:06:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:06:39 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Cloning volume 5e0ba8b8-8078-4b9d-bad0-abafe855691a to volume b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4 Jul 09 10:06:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Creating offline snapshot 45f8e97a-ceb0-4725-b676-992cc451f400 of volume 5e0ba8b8-8078-4b9d-bad0-abafe855691a {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:06:39 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddaeaa2a-f9b1-4e34-b085-0a0d3bc26c74]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:06:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:39 devstack sudo[95923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a Jul 09 10:06:39 devstack sudo[95923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:40 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_ptjombb0devstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640" returned: 0 in 2.458s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:40 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_8d0ac335-5303-45b7-a3b1-dafd02a5ccc9_ptjombb0devstack@QuobyteHD, size 112.00 MB, duration 2.46 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:06:40 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Converted 112.00 MB image at 45.54 MB/s Jul 09 10:06:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:40 devstack sudo[95926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 1G Jul 09 10:06:40 devstack sudo[95926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:40 devstack sudo[95923]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a" returned: 0 in 0.916s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:40 devstack sudo[95932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400 1G Jul 09 10:06:40 devstack sudo[95932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:41 devstack sudo[95926]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 1G" returned: 0 in 0.888s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:41 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[aeb6be1d-b804-48f2-9c9e-9adc97c10bc7]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:06:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:41 devstack sudo[95940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 Jul 09 10:06:41 devstack sudo[95940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:41 devstack sudo[95932]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400 1G" returned: 0 in 0.955s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:41 devstack sudo[95949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400 Jul 09 10:06:41 devstack sudo[95949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:42 devstack sudo[95940]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640" returned: 0 in 0.915s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:42 devstack sudo[95957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 Jul 09 10:06:42 devstack sudo[95957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:42 devstack sudo[95949]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400" returned: 0 in 0.831s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:42 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400 is being set with open permissions: ugo+rw Jul 09 10:06:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:42 devstack sudo[95959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400 Jul 09 10:06:42 devstack sudo[95959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:42 devstack sudo[95957]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640" returned: 1 in 0.944s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:06:43 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Downloaded image 8d0ac335-5303-45b7-a3b1-dafd02a5ccc9 ((None, [{'url': 'file:///opt/stack/data/glance/images/8d0ac335-5303-45b7-a3b1-dafd02a5ccc9', 'metadata': {}}])) to volume 6aea5e97-4659-4964-a73c-9f80963e7640 successfully. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 10:06:43 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Temporary image 8d0ac335-5303-45b7-a3b1-dafd02a5ccc9 for user 55ceeecab8564cb784913b1b79eee80a is deleted. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 10:06:43 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Marking volume 6aea5e97-4659-4964-a73c-9f80963e7640 as bootable. {{(pid=87192) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 10:06:43 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Copying metadata from image 8d0ac335-5303-45b7-a3b1-dafd02a5ccc9 to 6aea5e97-4659-4964-a73c-9f80963e7640. {{(pid=87192) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 10:06:43 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Creating volume glance metadata for volume 6aea5e97-4659-4964-a73c-9f80963e7640 backed by image 8d0ac335-5303-45b7-a3b1-dafd02a5ccc9 with: {'image_id': '8d0ac335-5303-45b7-a3b1-dafd02a5ccc9', 'image_name': 'tempest-scenario-img--1174457029', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87192) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 10:06:43 devstack sudo[95959]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400" returned: 0 in 0.842s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:43 devstack sudo[95965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.info Jul 09 10:06:43 devstack sudo[95965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b3347c8-c6c3-450f-94a2-42ebe8a5629e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6aea5e97-4659-4964-a73c-9f80963e7640', 'volume_size': 1, 'image_id': '8d0ac335-5303-45b7-a3b1-dafd02a5ccc9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/8d0ac335-5303-45b7-a3b1-dafd02a5ccc9', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1174457029', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '875c57d83f50436c8954f9bdea4d7657', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '8d0ac335-5303-45b7-a3b1-dafd02a5ccc9', 'created_at': datetime.datetime(2026, 7, 9, 8, 6, 21, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 8, 6, 23, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/8d0ac335-5303-45b7-a3b1-dafd02a5ccc9/file', 'properties': {}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6363a5fe-2cdc-4fda-9fa5-b7e94dd99138) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:43 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Volume volume-6aea5e97-4659-4964-a73c-9f80963e7640 (6aea5e97-4659-4964-a73c-9f80963e7640): created successfully Jul 09 10:06:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6363a5fe-2cdc-4fda-9fa5-b7e94dd99138) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Flow 'volume_create_manager' (a244605f-75f6-417d-b8a1-7641293de495) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:06:43 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-fac23b46-2a3b-409a-8a82-06aa80933dc4 tempest-TestInstancesWithCinderVolumes-144069202 None] Created volume successfully. Jul 09 10:06:43 devstack sudo[95965]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.info" returned: 0 in 0.734s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:43 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.info is being set with open permissions: ugo+rw Jul 09 10:06:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:43 devstack sudo[95969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.info Jul 09 10:06:43 devstack sudo[95969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:44 devstack sudo[95969]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.info" returned: 0 in 0.634s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Acquiring lock "cinder-quobyte-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:06:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Lock "cinder-quobyte-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4" acquired by "_copy_volume_from_snapshot" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:06:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] snapshot: 45f8e97a-ceb0-4725-b676-992cc451f400, volume: b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 10:06:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:06:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:06:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:06:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:06:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:06:44 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f41bb0a-b839-4e9f-bf4e-f7d86bf1d185]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:06:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:44 devstack sudo[95972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400 Jul 09 10:06:44 devstack sudo[95972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6034b9f9-66a5-46ff-beb4-12c1388a8036 tempest-BackendsCapabilitiesAdminTestsJSON-532897391 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87192) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 10:06:44 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-9ebb523e-ba34-4c22-9dcf-2872e78b2b7a req-3ca64111-9766-435e-893f-4b45ef41ee96 tempest-AttachVolumeNegativeTest-2008901733 None] Terminate volume connection completed successfully. Jul 09 10:06:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-9ebb523e-ba34-4c22-9dcf-2872e78b2b7a req-3ca64111-9766-435e-893f-4b45ef41ee96 tempest-AttachVolumeNegativeTest-2008901733 None] Deleting attachment 4986460e-296a-4fa4-a665-2334c0375db4. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:06:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1a66c59c-7bbf-4208-90d2-938f084a9e2b tempest-BackendsCapabilitiesAdminTestsJSON-532897391 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87192) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 10:06:45 devstack sudo[95972]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400" returned: 0 in 0.834s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:06:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 10:06:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 10:06:45 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcdb69f-9ca0-4c48-9e36-60d106649943]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:06:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:45 devstack sudo[95983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a Jul 09 10:06:45 devstack sudo[95983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:46 devstack sudo[95983]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a" returned: 0 in 0.813s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:46 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Path /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4 not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 10:06:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:46 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4 Jul 09 10:06:46 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-40c69c03-56fa-4af0-8c4c-e37c05d1eb34 req-a8c79933-7ede-4c93-9df1-55958142e299 tempest-TestInstancesWithCinderVolumes-144069202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:06:52 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4" returned: 0 in 6.514s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:52 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[50020e7f-a279-48ce-b0bb-37f7227dc8c7]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:06:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:52 devstack sudo[96038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a Jul 09 10:06:52 devstack sudo[96038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:54 devstack sudo[96038]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a" returned: 0 in 1.252s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:54 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Image conversion details: src /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:06:54 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Converted 1024.00 MB image at 157.17 MB/s Jul 09 10:06:54 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4 is being set with open permissions: ugo+rw Jul 09 10:06:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:54 devstack sudo[96044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4 Jul 09 10:06:54 devstack sudo[96044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:54 devstack sudo[96044]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4" returned: 0 in 0.719s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Lock "cinder-quobyte-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4" released by "_copy_volume_from_snapshot" :: held 10.246s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:06:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Acquiring lock "cinder-quobyte-45f8e97a-ceb0-4725-b676-992cc451f400" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:06:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Lock "cinder-quobyte-45f8e97a-ceb0-4725-b676-992cc451f400" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:06:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Deleting offline snapshot 45f8e97a-ceb0-4725-b676-992cc451f400 of volume 5e0ba8b8-8078-4b9d-bad0-abafe855691a {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:06:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] snapshot_file for this snap is: volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:06:54 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[302bfa07-708b-401c-9257-6038bd8db6cb]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:06:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:55 devstack sudo[96048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400 Jul 09 10:06:55 devstack sudo[96048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-fccf1eda-825a-471d-a5e0-37358dce8f5e tempest-GroupSnapshotsV319Test-1312323101 None] Group tempest-GroupSnapshotsV319Test-Group-1420096454: creating Jul 09 10:06:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-fccf1eda-825a-471d-a5e0-37358dce8f5e tempest-GroupSnapshotsV319Test-1312323101 None] Group tempest-GroupSnapshotsV319Test-Group-1420096454: created successfully Jul 09 10:06:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-fccf1eda-825a-471d-a5e0-37358dce8f5e tempest-GroupSnapshotsV319Test-1312323101 None] Create group completed successfully. Jul 09 10:06:55 devstack sudo[96048]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400" returned: 0 in 0.857s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:06:55 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b2881eb-79ee-43bd-b60a-4127393bef28]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:06:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:55 devstack sudo[96054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a Jul 09 10:06:55 devstack sudo[96054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:56 devstack sudo[96054]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a" returned: 0 in 0.819s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:56 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400 Jul 09 10:06:56 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:57 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:06:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Flow 'volume_create_manager' (c94cd66c-877b-44ef-810e-58ca1936132c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:06:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef337ccd-2ddd-40fa-8b06-5c3f42b75510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef337ccd-2ddd-40fa-8b06-5c3f42b75510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2039430503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=395599e5-67dc-449d-b0af-6032e59c658d,host='devstack@QuobyteHD#QuobyteHD',id=2e8c024b-afeb-41aa-8f6d-c50c91368517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1da31193cd4bc8afcb22f970f9d3a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:06:57Z,use_quota=True,user_id='3ca845e9aa264c838d58a7edad840a5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d345c93d-3462-49e1-9607-47899513dc8e),volume_type_id=d345c93d-3462-49e1-9607-47899513dc8e)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af2eba3-e1f7-4e80-86f3-b7242387cb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3af2eba3-e1f7-4e80-86f3-b7242387cb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d7d818-d385-4b3e-b38f-019a71f99d23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97d7d818-d385-4b3e-b38f-019a71f99d23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e8c024b-afeb-41aa-8f6d-c50c91368517', 'volume_name': 'volume-2e8c024b-afeb-41aa-8f6d-c50c91368517', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99781651-2460-4228-a4da-d60c8b1ac753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:57 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99781651-2460-4228-a4da-d60c8b1ac753) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8792c3ec-af1e-45d3-8547-d0fcf57d7218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Volume 2e8c024b-afeb-41aa-8f6d-c50c91368517: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e8c024b-afeb-41aa-8f6d-c50c91368517', 'volume_size': 1} Jul 09 10:06:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:06:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400" returned: 0 in 0.955s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:57 devstack sudo[96065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400 Jul 09 10:06:57 devstack sudo[96065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:58 devstack sudo[96065]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a.45f8e97a-ceb0-4725-b676-992cc451f400" returned: 0 in 0.707s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Lock "cinder-quobyte-45f8e97a-ceb0-4725-b676-992cc451f400" released by "_delete_snapshot" :: held 3.448s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:06:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.909s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:06:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-40c69c03-56fa-4af0-8c4c-e37c05d1eb34 req-a8c79933-7ede-4c93-9df1-55958142e299 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 6.321s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:06:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5fb46b03-6911-4138-9cbe-6d3a92390af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4', 'volume_size': 2, 'source_volid': '5e0ba8b8-8078-4b9d-bad0-abafe855691a', 'source_volstatus': 'available'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921ab6b7-b073-487c-875a-69e688556b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:06:58 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Volume volume-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4 (b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4): created successfully Jul 09 10:06:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (921ab6b7-b073-487c-875a-69e688556b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:06:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Flow 'volume_create_manager' (8056e488-2b9a-4e83-a47f-f9bd8f190ed8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:06:58 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[84c2ac07-e37e-45d3-8c00-b15fad44b5ac]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:06:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-40c69c03-56fa-4af0-8c4c-e37c05d1eb34 req-a8c79933-7ede-4c93-9df1-55958142e299 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:58 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-dad30b63-ffff-4f10-b59a-d18639cdb1b3 tempest-VolumesCloneTest-5161880 None] Created volume successfully. Jul 09 10:06:58 devstack sudo[96069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 Jul 09 10:06:58 devstack sudo[96069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:59 devstack sudo[96069]: pam_unix(sudo:session): session closed for user root Jul 09 10:06:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-40c69c03-56fa-4af0-8c4c-e37c05d1eb34 req-a8c79933-7ede-4c93-9df1-55958142e299 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640" returned: 0 in 0.779s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:06:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-40c69c03-56fa-4af0-8c4c-e37c05d1eb34 req-a8c79933-7ede-4c93-9df1-55958142e299 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:59 devstack sudo[96073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 Jul 09 10:06:59 devstack sudo[96073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:06:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-311832b9-89e4-4b03-bca2-cf4ac311cb39 tempest-VolumesCloneTest-5161880 None] Acquiring lock "cinder-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:06:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-311832b9-89e4-4b03-bca2-cf4ac311cb39 tempest-VolumesCloneTest-5161880 None] Lock "cinder-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:06:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-311832b9-89e4-4b03-bca2-cf4ac311cb39 tempest-VolumesCloneTest-5161880 None] Acquiring lock "cinder-quobyte-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:06:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-311832b9-89e4-4b03-bca2-cf4ac311cb39 tempest-VolumesCloneTest-5161880 None] Lock "cinder-quobyte-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:06:59 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf7ce4bb-94b7-40d3-8441-8ad5785c5450]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:06:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-311832b9-89e4-4b03-bca2-cf4ac311cb39 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:06:59 devstack sudo[96075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4 Jul 09 10:06:59 devstack sudo[96075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:00 devstack sudo[96073]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-40c69c03-56fa-4af0-8c4c-e37c05d1eb34 req-a8c79933-7ede-4c93-9df1-55958142e299 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640" returned: 1 in 0.854s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-40c69c03-56fa-4af0-8c4c-e37c05d1eb34 req-a8c79933-7ede-4c93-9df1-55958142e299 tempest-TestInstancesWithCinderVolumes-144069202 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:07:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-40c69c03-56fa-4af0-8c4c-e37c05d1eb34 req-a8c79933-7ede-4c93-9df1-55958142e299 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.697s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.484s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=395599e5-67dc-449d-b0af-6032e59c658d,created_at=2026-07-09T08:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2039430503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=395599e5-67dc-449d-b0af-6032e59c658d,host='devstack@QuobyteHD#QuobyteHD',id=2e8c024b-afeb-41aa-8f6d-c50c91368517,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e1da31193cd4bc8afcb22f970f9d3a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:06:57Z,use_quota=True,user_id='3ca845e9aa264c838d58a7edad840a5b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d345c93d-3462-49e1-9607-47899513dc8e),volume_type_id=d345c93d-3462-49e1-9607-47899513dc8e)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:07:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Creating volume 2e8c024b-afeb-41aa-8f6d-c50c91368517 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:07:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:07:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:07:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:07:00 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:07:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-40c69c03-56fa-4af0-8c4c-e37c05d1eb34 req-a8c79933-7ede-4c93-9df1-55958142e299 tempest-TestInstancesWithCinderVolumes-144069202 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-6aea5e97-4659-4964-a73c-9f80963e7640', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '11f2583f-4315-4039-aabb-8df9a3a5db31', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:07:00 devstack sudo[96083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517 1073741824 Jul 09 10:07:00 devstack sudo[96083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-40c69c03-56fa-4af0-8c4c-e37c05d1eb34 req-a8c79933-7ede-4c93-9df1-55958142e299 tempest-TestInstancesWithCinderVolumes-144069202 None] attachment_update completed successfully. Jul 09 10:07:00 devstack sudo[96075]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-311832b9-89e4-4b03-bca2-cf4ac311cb39 tempest-VolumesCloneTest-5161880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4" returned: 0 in 0.918s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-311832b9-89e4-4b03-bca2-cf4ac311cb39 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:00 devstack sudo[96090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4 Jul 09 10:07:00 devstack sudo[96090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:01 devstack sudo[96083]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517 1073741824" returned: 0 in 0.988s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:01 devstack sudo[96094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517 Jul 09 10:07:01 devstack sudo[96094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:01 devstack sudo[96090]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-311832b9-89e4-4b03-bca2-cf4ac311cb39 tempest-VolumesCloneTest-5161880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4" returned: 0 in 0.717s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-311832b9-89e4-4b03-bca2-cf4ac311cb39 tempest-VolumesCloneTest-5161880 None] Lock "cinder-quobyte-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4" released by "delete_volume" :: held 1.697s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:07:01 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-311832b9-89e4-4b03-bca2-cf4ac311cb39 tempest-VolumesCloneTest-5161880 None] Created reservations ['9a001b07-db6f-4415-805d-0701d3ba4f0e', '8cf736ef-952d-4f34-9175-3e3ed3ecb032', 'f385f034-6473-4208-8050-365a9a5d5093', 'e3b52582-f65c-4f05-a749-4f952f817a80'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:07:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-311832b9-89e4-4b03-bca2-cf4ac311cb39 tempest-VolumesCloneTest-5161880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-311832b9-89e4-4b03-bca2-cf4ac311cb39 tempest-VolumesCloneTest-5161880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-311832b9-89e4-4b03-bca2-cf4ac311cb39 tempest-VolumesCloneTest-5161880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:07:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-311832b9-89e4-4b03-bca2-cf4ac311cb39 tempest-VolumesCloneTest-5161880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:07:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-311832b9-89e4-4b03-bca2-cf4ac311cb39 tempest-VolumesCloneTest-5161880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-311832b9-89e4-4b03-bca2-cf4ac311cb39 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:01 devstack sudo[96097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:07:01 devstack sudo[96097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:01 devstack sudo[96094]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517" returned: 0 in 0.683s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:07:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.740s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8792c3ec-af1e-45d3-8547-d0fcf57d7218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e8c024b-afeb-41aa-8f6d-c50c91368517', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf11715f-8c2b-4b7f-b336-de1de18889e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:01 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Volume volume-2e8c024b-afeb-41aa-8f6d-c50c91368517 (2e8c024b-afeb-41aa-8f6d-c50c91368517): created successfully Jul 09 10:07:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf11715f-8c2b-4b7f-b336-de1de18889e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Flow 'volume_create_manager' (c94cd66c-877b-44ef-810e-58ca1936132c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:07:01 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4a81e684-d8a6-48b1-97c6-a20982119ad4 tempest-GroupSnapshotsV319Test-1312323101 None] Created volume successfully. Jul 09 10:07:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-56a8a188-b7ee-4f76-a426-80e5d740a598 tempest-VolumesCloneTest-5161880 None] Acquiring lock "cinder-5e0ba8b8-8078-4b9d-bad0-abafe855691a-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:07:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-56a8a188-b7ee-4f76-a426-80e5d740a598 tempest-VolumesCloneTest-5161880 None] Lock "cinder-5e0ba8b8-8078-4b9d-bad0-abafe855691a-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:07:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-56a8a188-b7ee-4f76-a426-80e5d740a598 tempest-VolumesCloneTest-5161880 None] Acquiring lock "cinder-quobyte-5e0ba8b8-8078-4b9d-bad0-abafe855691a" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:07:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-56a8a188-b7ee-4f76-a426-80e5d740a598 tempest-VolumesCloneTest-5161880 None] Lock "cinder-quobyte-5e0ba8b8-8078-4b9d-bad0-abafe855691a" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:07:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[78fa278f-3bb7-4c8a-a955-e0a3d99bac30]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:07:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-56a8a188-b7ee-4f76-a426-80e5d740a598 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:02 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a Jul 09 10:07:02 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:02 devstack sudo[96097]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-311832b9-89e4-4b03-bca2-cf4ac311cb39 tempest-VolumesCloneTest-5161880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.797s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:02 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-311832b9-89e4-4b03-bca2-cf4ac311cb39 tempest-VolumesCloneTest-5161880 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:07:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-311832b9-89e4-4b03-bca2-cf4ac311cb39 tempest-VolumesCloneTest-5161880 None] Deleted volume successfully. Jul 09 10:07:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-311832b9-89e4-4b03-bca2-cf4ac311cb39 tempest-VolumesCloneTest-5161880 None] Lock "cinder-b16d3f44-6ed5-4bbf-818f-70b6f0a14aa4-delete_volume" released by "delete_volume" :: held 2.802s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:07:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] GroupSnapshot 534a57d1-390a-45ce-b932-e0e8ea602d9d: creating. Jul 09 10:07:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] Group snapshot 534a57d1-390a-45ce-b932-e0e8ea602d9d: creating. {{(pid=87192) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 09 10:07:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] Creating offline snapshot 4757bdca-7a6f-4884-a2fc-4306eabab422 of volume 2e8c024b-afeb-41aa-8f6d-c50c91368517 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:07:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ef9148f-ed7f-45f1-877b-d1da55b38f56]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:07:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:02 devstack sudo[96171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517 Jul 09 10:07:02 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:03 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-56a8a188-b7ee-4f76-a426-80e5d740a598 tempest-VolumesCloneTest-5161880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a" returned: 0 in 0.909s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-56a8a188-b7ee-4f76-a426-80e5d740a598 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:03 devstack sudo[96176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a Jul 09 10:07:03 devstack sudo[96176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:03 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517" returned: 0 in 0.765s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.4757bdca-7a6f-4884-a2fc-4306eabab422 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:03 devstack sudo[96181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.4757bdca-7a6f-4884-a2fc-4306eabab422 1G Jul 09 10:07:03 devstack sudo[96181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:03 devstack sudo[96176]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-56a8a188-b7ee-4f76-a426-80e5d740a598 tempest-VolumesCloneTest-5161880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5e0ba8b8-8078-4b9d-bad0-abafe855691a" returned: 0 in 0.833s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-56a8a188-b7ee-4f76-a426-80e5d740a598 tempest-VolumesCloneTest-5161880 None] Lock "cinder-quobyte-5e0ba8b8-8078-4b9d-bad0-abafe855691a" released by "delete_volume" :: held 1.834s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:07:04 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-56a8a188-b7ee-4f76-a426-80e5d740a598 tempest-VolumesCloneTest-5161880 None] Created reservations ['0d8e29e1-7878-43af-9b8c-3120437e67a3', '33cb253c-fba0-4906-bc62-aeb703aba4b7', '775505da-6d07-4eb3-bc8a-9a8351970ecd', '1409236f-559e-45fa-9c69-92c868e05c34'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:07:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-56a8a188-b7ee-4f76-a426-80e5d740a598 tempest-VolumesCloneTest-5161880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-56a8a188-b7ee-4f76-a426-80e5d740a598 tempest-VolumesCloneTest-5161880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-56a8a188-b7ee-4f76-a426-80e5d740a598 tempest-VolumesCloneTest-5161880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:07:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-56a8a188-b7ee-4f76-a426-80e5d740a598 tempest-VolumesCloneTest-5161880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:07:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-56a8a188-b7ee-4f76-a426-80e5d740a598 tempest-VolumesCloneTest-5161880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-56a8a188-b7ee-4f76-a426-80e5d740a598 tempest-VolumesCloneTest-5161880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:04 devstack sudo[96220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:07:04 devstack sudo[96220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:04 devstack sudo[96181]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.4757bdca-7a6f-4884-a2fc-4306eabab422 1G" returned: 0 in 1.385s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e8c024b-afeb-41aa-8f6d-c50c91368517 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.4757bdca-7a6f-4884-a2fc-4306eabab422 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:04 devstack sudo[96236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e8c024b-afeb-41aa-8f6d-c50c91368517 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.4757bdca-7a6f-4884-a2fc-4306eabab422 Jul 09 10:07:04 devstack sudo[96236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:05 devstack sudo[96220]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-56a8a188-b7ee-4f76-a426-80e5d740a598 tempest-VolumesCloneTest-5161880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.098s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:05 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-56a8a188-b7ee-4f76-a426-80e5d740a598 tempest-VolumesCloneTest-5161880 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:07:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-56a8a188-b7ee-4f76-a426-80e5d740a598 tempest-VolumesCloneTest-5161880 None] Deleted volume successfully. Jul 09 10:07:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-56a8a188-b7ee-4f76-a426-80e5d740a598 tempest-VolumesCloneTest-5161880 None] Lock "cinder-5e0ba8b8-8078-4b9d-bad0-abafe855691a-delete_volume" released by "delete_volume" :: held 3.347s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:07:05 devstack sudo[96236]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2e8c024b-afeb-41aa-8f6d-c50c91368517 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.4757bdca-7a6f-4884-a2fc-4306eabab422" returned: 0 in 1.087s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:05 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.4757bdca-7a6f-4884-a2fc-4306eabab422 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 10:07:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.4757bdca-7a6f-4884-a2fc-4306eabab422 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:05 devstack sudo[96574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.4757bdca-7a6f-4884-a2fc-4306eabab422 Jul 09 10:07:05 devstack sudo[96574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:06 devstack sudo[96574]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.4757bdca-7a6f-4884-a2fc-4306eabab422" returned: 0 in 1.035s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:07 devstack sudo[96583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.info Jul 09 10:07:07 devstack sudo[96583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:08 devstack sudo[96583]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.info" returned: 0 in 1.517s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:08 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 10:07:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:08 devstack sudo[96600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.info Jul 09 10:07:08 devstack sudo[96600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:09 devstack sudo[96600]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.info" returned: 0 in 0.789s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.715s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:09 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5029fa20-2212-438a-afa3-e730c4366370 tempest-GroupSnapshotsV319Test-1312323101 None] group_snapshot 534a57d1-390a-45ce-b932-e0e8ea602d9d: created successfully Jul 09 10:07:10 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] group_snapshot 534a57d1-390a-45ce-b932-e0e8ea602d9d: deleting Jul 09 10:07:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] group_snapshot 534a57d1-390a-45ce-b932-e0e8ea602d9d: deleting {{(pid=87192) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 09 10:07:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] Acquiring lock "cinder-quobyte-2e8c024b-afeb-41aa-8f6d-c50c91368517" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:07:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] Lock "cinder-quobyte-2e8c024b-afeb-41aa-8f6d-c50c91368517" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:07:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] Acquiring lock "cinder-quobyte-4757bdca-7a6f-4884-a2fc-4306eabab422" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:07:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] Lock "cinder-quobyte-4757bdca-7a6f-4884-a2fc-4306eabab422" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:07:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] Deleting offline snapshot 4757bdca-7a6f-4884-a2fc-4306eabab422 of volume 2e8c024b-afeb-41aa-8f6d-c50c91368517 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:07:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] snapshot_file for this snap is: volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.4757bdca-7a6f-4884-a2fc-4306eabab422 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:07:11 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1240e215-8824-4aff-a990-5be1367b7568]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:07:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.4757bdca-7a6f-4884-a2fc-4306eabab422 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:11 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.4757bdca-7a6f-4884-a2fc-4306eabab422 Jul 09 10:07:11 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:12 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.4757bdca-7a6f-4884-a2fc-4306eabab422" returned: 0 in 1.559s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2e8c024b-afeb-41aa-8f6d-c50c91368517(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:07:12 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6be5439f-36c6-488c-ac43-4855f851dc3b]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:07:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:12 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517 Jul 09 10:07:12 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:14 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517" returned: 0 in 1.702s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.4757bdca-7a6f-4884-a2fc-4306eabab422 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:14 devstack sudo[96683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.4757bdca-7a6f-4884-a2fc-4306eabab422 Jul 09 10:07:14 devstack sudo[96683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:16 devstack sudo[96683]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.4757bdca-7a6f-4884-a2fc-4306eabab422" returned: 0 in 1.915s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.4757bdca-7a6f-4884-a2fc-4306eabab422 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:16 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.4757bdca-7a6f-4884-a2fc-4306eabab422 Jul 09 10:07:16 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:17 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517.4757bdca-7a6f-4884-a2fc-4306eabab422" returned: 0 in 1.395s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] Lock "cinder-quobyte-4757bdca-7a6f-4884-a2fc-4306eabab422" released by "_delete_snapshot" :: held 6.763s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:07:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] Lock "cinder-quobyte-2e8c024b-afeb-41aa-8f6d-c50c91368517" released by "delete_snapshot" :: held 6.816s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:07:17 devstack cinder-volume[87192]: WARNING cinder.quota [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1461580285 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1461580285, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:07:17 devstack cinder-volume[87192]: WARNING cinder.quota [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1461580285 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1461580285, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:07:17 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] Created reservations ['e8b5cafc-f692-4bf0-9e04-ac06e9341dd3', 'ada72f3f-ecd5-441a-add6-df0972482715', '28afe756-c288-4cca-8704-8006d4539f2a', '717d979d-c05b-4960-8a50-eaf5dff07acc'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:07:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-22c2b421-5b73-49e8-8d3f-d3c11b8dac03 tempest-GroupSnapshotsV319Test-1312323101 None] group_snapshot 534a57d1-390a-45ce-b932-e0e8ea602d9d: deleted successfully Jul 09 10:07:19 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=62,cinder:UPDATE=64,cinder:INSERT=20,cinder:DELETE=6 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:07:19 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=70,cinder:SELECT=66,cinder:DELETE=5,cinder:INSERT=19 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:07:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9507d35d-ccb0-46ae-a1af-bea4067e9e7e tempest-GroupSnapshotsV319Test-1312323101 None] Acquiring lock "cinder-quobyte-2e8c024b-afeb-41aa-8f6d-c50c91368517" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:07:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9507d35d-ccb0-46ae-a1af-bea4067e9e7e tempest-GroupSnapshotsV319Test-1312323101 None] Lock "cinder-quobyte-2e8c024b-afeb-41aa-8f6d-c50c91368517" acquired by "delete_volume" :: waited 0.067s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:07:19 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[763a6fbe-8932-462a-aaa5-f702fd109417]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:07:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9507d35d-ccb0-46ae-a1af-bea4067e9e7e tempest-GroupSnapshotsV319Test-1312323101 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:19 devstack sudo[96694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517 Jul 09 10:07:19 devstack sudo[96694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:20 devstack sudo[96694]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9507d35d-ccb0-46ae-a1af-bea4067e9e7e tempest-GroupSnapshotsV319Test-1312323101 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517" returned: 0 in 1.234s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9507d35d-ccb0-46ae-a1af-bea4067e9e7e tempest-GroupSnapshotsV319Test-1312323101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:21 devstack sudo[96700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517 Jul 09 10:07:21 devstack sudo[96700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:22 devstack sudo[96700]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9507d35d-ccb0-46ae-a1af-bea4067e9e7e tempest-GroupSnapshotsV319Test-1312323101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2e8c024b-afeb-41aa-8f6d-c50c91368517" returned: 0 in 1.384s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9507d35d-ccb0-46ae-a1af-bea4067e9e7e tempest-GroupSnapshotsV319Test-1312323101 None] Lock "cinder-quobyte-2e8c024b-afeb-41aa-8f6d-c50c91368517" released by "delete_volume" :: held 2.780s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:07:22 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-9507d35d-ccb0-46ae-a1af-bea4067e9e7e tempest-GroupSnapshotsV319Test-1312323101 None] Created reservations ['6cb1c513-c71c-4d07-adaf-68d35ca1c6e9'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:07:22 devstack cinder-volume[87192]: WARNING cinder.quota [None req-9507d35d-ccb0-46ae-a1af-bea4067e9e7e tempest-GroupSnapshotsV319Test-1312323101 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1461580285 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1461580285, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:07:22 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-9507d35d-ccb0-46ae-a1af-bea4067e9e7e tempest-GroupSnapshotsV319Test-1312323101 None] Created reservations ['ea35f75c-4763-4ff6-bc89-0e7b53e6f4b1', 'ca6cfc5d-9840-461b-a552-c64f2b63a7d0', 'cdcc2490-eda9-4ed4-968a-a6545ddc71aa', '6bf82871-60a7-4ad3-9076-c023db817507'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:07:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9507d35d-ccb0-46ae-a1af-bea4067e9e7e tempest-GroupSnapshotsV319Test-1312323101 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9507d35d-ccb0-46ae-a1af-bea4067e9e7e tempest-GroupSnapshotsV319Test-1312323101 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9507d35d-ccb0-46ae-a1af-bea4067e9e7e tempest-GroupSnapshotsV319Test-1312323101 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:07:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9507d35d-ccb0-46ae-a1af-bea4067e9e7e tempest-GroupSnapshotsV319Test-1312323101 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:07:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9507d35d-ccb0-46ae-a1af-bea4067e9e7e tempest-GroupSnapshotsV319Test-1312323101 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9507d35d-ccb0-46ae-a1af-bea4067e9e7e tempest-GroupSnapshotsV319Test-1312323101 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:22 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:07:22 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:24 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9507d35d-ccb0-46ae-a1af-bea4067e9e7e tempest-GroupSnapshotsV319Test-1312323101 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.186s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:24 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-9507d35d-ccb0-46ae-a1af-bea4067e9e7e tempest-GroupSnapshotsV319Test-1312323101 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:07:24 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9507d35d-ccb0-46ae-a1af-bea4067e9e7e tempest-GroupSnapshotsV319Test-1312323101 None] Delete group completed successfully. Jul 09 10:07:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:07:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:07:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:07:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:29 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:07:29 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:30 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.828s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:07:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:07:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:07:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Flow 'volume_create_manager' (7aa140b1-0d7a-40bc-a048-df8429f62caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0145b1f-6ece-4059-9ee6-f1483f2093cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0145b1f-6ece-4059-9ee6-f1483f2093cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1819416924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1e2f8c-9f05-4ff0-8951-eabd1d46993a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881b76c1042a4098baf5421bcbe001bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:07:31Z,use_quota=True,user_id='92298f2eb1c84c37bf70ad8de84230f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f909a1f9-4174-493c-ad83-db53d9cf7df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f909a1f9-4174-493c-ad83-db53d9cf7df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59819be0-6a75-4a10-bd83-d0304cb5f3a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (59819be0-6a75-4a10-bd83-d0304cb5f3a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e1e2f8c-9f05-4ff0-8951-eabd1d46993a', 'volume_name': 'volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a7581f-73a2-495e-944f-2b81896bb837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00a7581f-73a2-495e-944f-2b81896bb837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a951e50a-e099-48ca-ad0d-4a93a95c9307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:31 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Volume 9e1e2f8c-9f05-4ff0-8951-eabd1d46993a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a', 'volume_size': 1} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:07:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1819416924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e1e2f8c-9f05-4ff0-8951-eabd1d46993a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881b76c1042a4098baf5421bcbe001bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:07:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:07:31Z,use_quota=True,user_id='92298f2eb1c84c37bf70ad8de84230f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Creating volume 9e1e2f8c-9f05-4ff0-8951-eabd1d46993a {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:07:31 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:07:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:31 devstack sudo[96865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a 1073741824 Jul 09 10:07:31 devstack sudo[96865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:32 devstack sudo[96865]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a 1073741824" returned: 0 in 0.945s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:32 devstack sudo[96871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a Jul 09 10:07:32 devstack sudo[96871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:33 devstack sudo[96871]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a" returned: 0 in 0.759s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] <== create_volume: return (1754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:07:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.757s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a951e50a-e099-48ca-ad0d-4a93a95c9307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (903b4e4e-ce79-45d5-9357-b2a0d4606276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:33 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Volume volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a (9e1e2f8c-9f05-4ff0-8951-eabd1d46993a): created successfully Jul 09 10:07:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (903b4e4e-ce79-45d5-9357-b2a0d4606276) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Flow 'volume_create_manager' (7aa140b1-0d7a-40bc-a048-df8429f62caa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:07:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b5afd50d-143a-4f20-bbec-c32d9dedbda7 tempest-VolumesSnapshotTestJSON-321199851 None] Created volume successfully. Jul 09 10:07:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b99d149d-56c2-4ff7-9c9e-f7ddbdad4db9 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b99d149d-56c2-4ff7-9c9e-f7ddbdad4db9 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b99d149d-56c2-4ff7-9c9e-f7ddbdad4db9 tempest-VolumesSnapshotTestJSON-321199851 None] Creating offline snapshot 98cb392c-0a4c-45dc-8764-db26f4502406 of volume 9e1e2f8c-9f05-4ff0-8951-eabd1d46993a {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:07:33 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0059914-1f47-453b-ade8-d04e476f8c01]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:07:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b99d149d-56c2-4ff7-9c9e-f7ddbdad4db9 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:33 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a Jul 09 10:07:33 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:34 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b99d149d-56c2-4ff7-9c9e-f7ddbdad4db9 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a" returned: 0 in 0.923s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b99d149d-56c2-4ff7-9c9e-f7ddbdad4db9 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.98cb392c-0a4c-45dc-8764-db26f4502406 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:34 devstack sudo[96886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.98cb392c-0a4c-45dc-8764-db26f4502406 1G Jul 09 10:07:34 devstack sudo[96886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:35 devstack sudo[96886]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b99d149d-56c2-4ff7-9c9e-f7ddbdad4db9 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.98cb392c-0a4c-45dc-8764-db26f4502406 1G" returned: 0 in 1.022s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b99d149d-56c2-4ff7-9c9e-f7ddbdad4db9 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.98cb392c-0a4c-45dc-8764-db26f4502406 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:35 devstack sudo[96902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.98cb392c-0a4c-45dc-8764-db26f4502406 Jul 09 10:07:35 devstack sudo[96902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:36 devstack sudo[96902]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b99d149d-56c2-4ff7-9c9e-f7ddbdad4db9 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.98cb392c-0a4c-45dc-8764-db26f4502406" returned: 0 in 0.746s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:36 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-b99d149d-56c2-4ff7-9c9e-f7ddbdad4db9 tempest-VolumesSnapshotTestJSON-321199851 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.98cb392c-0a4c-45dc-8764-db26f4502406 is being set with open permissions: ugo+rw Jul 09 10:07:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b99d149d-56c2-4ff7-9c9e-f7ddbdad4db9 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.98cb392c-0a4c-45dc-8764-db26f4502406 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:36 devstack sudo[96908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.98cb392c-0a4c-45dc-8764-db26f4502406 Jul 09 10:07:36 devstack sudo[96908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:37 devstack sudo[96908]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b99d149d-56c2-4ff7-9c9e-f7ddbdad4db9 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.98cb392c-0a4c-45dc-8764-db26f4502406" returned: 0 in 0.725s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b99d149d-56c2-4ff7-9c9e-f7ddbdad4db9 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:37 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.info Jul 09 10:07:37 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:38 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b99d149d-56c2-4ff7-9c9e-f7ddbdad4db9 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.info" returned: 0 in 0.772s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:38 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-b99d149d-56c2-4ff7-9c9e-f7ddbdad4db9 tempest-VolumesSnapshotTestJSON-321199851 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.info is being set with open permissions: ugo+rw Jul 09 10:07:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b99d149d-56c2-4ff7-9c9e-f7ddbdad4db9 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:38 devstack sudo[96915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.info Jul 09 10:07:38 devstack sudo[96915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-9b1d826c-e6dd-4b7c-8948-2961cf48bc6c req-599d863d-6f6f-472d-bd0c-beca181f466f tempest-TestInstancesWithCinderVolumes-144069202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:38 devstack sudo[96915]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b99d149d-56c2-4ff7-9c9e-f7ddbdad4db9 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.info" returned: 0 in 0.788s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b99d149d-56c2-4ff7-9c9e-f7ddbdad4db9 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.074s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-9b1d826c-e6dd-4b7c-8948-2961cf48bc6c req-599d863d-6f6f-472d-bd0c-beca181f466f tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.047s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d57587-c570-4e02-82dc-381d24dd6b83]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:07:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-9b1d826c-e6dd-4b7c-8948-2961cf48bc6c req-599d863d-6f6f-472d-bd0c-beca181f466f tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-702c3c2e-9669-4ec8-8131-7957b3e47ec0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:38 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b99d149d-56c2-4ff7-9c9e-f7ddbdad4db9 tempest-VolumesSnapshotTestJSON-321199851 None] Create snapshot completed successfully Jul 09 10:07:39 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-702c3c2e-9669-4ec8-8131-7957b3e47ec0 Jul 09 10:07:39 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:39 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-9b1d826c-e6dd-4b7c-8948-2961cf48bc6c req-599d863d-6f6f-472d-bd0c-beca181f466f tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-702c3c2e-9669-4ec8-8131-7957b3e47ec0" returned: 0 in 0.877s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-9b1d826c-e6dd-4b7c-8948-2961cf48bc6c req-599d863d-6f6f-472d-bd0c-beca181f466f tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.901s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Flow 'volume_create_manager' (512a4daa-e3b2-4d58-b3b2-e210c4600aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a069b1-61b0-42bf-8bd3-f677e51fa674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-9b1d826c-e6dd-4b7c-8948-2961cf48bc6c req-599d863d-6f6f-472d-bd0c-beca181f466f tempest-TestInstancesWithCinderVolumes-144069202 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-702c3c2e-9669-4ec8-8131-7957b3e47ec0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '789f6dd4-f57c-4f1d-9cbb-e6a1c194ca09', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-98cb392c-0a4c-45dc-8764-db26f4502406-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8a069b1-61b0-42bf-8bd3-f677e51fa674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-523432784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c058ebfbf94d1c9a0dd725f9b0e9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:07:40Z,use_quota=True,user_id='ed85355d43ea408486d8c5e303e836f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0407ba97-b24d-4d1e-9b8a-c322273f8375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0407ba97-b24d-4d1e-9b8a-c322273f8375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70b76ce-9467-48ca-b16d-a68289200652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e70b76ce-9467-48ca-b16d-a68289200652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2', 'volume_name': 'volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa8be27e-4718-41d9-9030-f30bddc82659) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa8be27e-4718-41d9-9030-f30bddc82659) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07db8d0-52ea-4331-a209-9b30764841a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:39 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Volume 4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2', 'volume_size': 1} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:07:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-523432784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='34c058ebfbf94d1c9a0dd725f9b0e9cd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:07:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:07:40Z,use_quota=True,user_id='ed85355d43ea408486d8c5e303e836f8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Creating volume 4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:07:39 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-98cb392c-0a4c-45dc-8764-db26f4502406-delete_snapshot" acquired by "delete_snapshot" :: waited 0.094s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:07:39 devstack sudo[96931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 1073741824 Jul 09 10:07:39 devstack sudo[96931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:40 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-9b1d826c-e6dd-4b7c-8948-2961cf48bc6c req-599d863d-6f6f-472d-bd0c-beca181f466f tempest-TestInstancesWithCinderVolumes-144069202 None] attachment_update completed successfully. Jul 09 10:07:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-quobyte-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:07:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:07:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-quobyte-98cb392c-0a4c-45dc-8764-db26f4502406" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:07:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-98cb392c-0a4c-45dc-8764-db26f4502406" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:07:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] Deleting offline snapshot 98cb392c-0a4c-45dc-8764-db26f4502406 of volume 9e1e2f8c-9f05-4ff0-8951-eabd1d46993a {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:07:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] snapshot_file for this snap is: volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.98cb392c-0a4c-45dc-8764-db26f4502406 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:07:40 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[340393b3-11d2-4760-a500-e0e6cf5c7f4e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:07:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.98cb392c-0a4c-45dc-8764-db26f4502406 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:40 devstack sudo[96933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.98cb392c-0a4c-45dc-8764-db26f4502406 Jul 09 10:07:40 devstack sudo[96933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:40 devstack sudo[96933]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.98cb392c-0a4c-45dc-8764-db26f4502406" returned: 0 in 0.800s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:07:40 devstack sudo[96931]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 1073741824" returned: 0 in 0.970s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:40 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2253ca78-a2ae-4059-98f0-bbe21a9e1036]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:07:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:41 devstack sudo[96947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 Jul 09 10:07:41 devstack sudo[96947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:41 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a Jul 09 10:07:41 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Flow 'volume_create_manager' (8f1ab50e-f6f3-465f-980a-0ccc47806ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abffa304-fd02-499f-a106-14828e040bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abffa304-fd02-499f-a106-14828e040bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1440003600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52214a6-c49f-424a-8914-36fbb1e0ca87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec38f289c25142c1a62c63608dcf0cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:07:41Z,use_quota=True,user_id='4e39e88da70a41b497347e00a5c2574c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3ebe25-1623-4d36-b179-4b9e2297bf4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f3ebe25-1623-4d36-b179-4b9e2297bf4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2802b9e8-0202-4c0c-b45a-d5dc919c442b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2802b9e8-0202-4c0c-b45a-d5dc919c442b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a52214a6-c49f-424a-8914-36fbb1e0ca87', 'volume_name': 'volume-a52214a6-c49f-424a-8914-36fbb1e0ca87', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db59149-1429-4029-b2a1-9f0077683a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9db59149-1429-4029-b2a1-9f0077683a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ad7567-bdca-499c-83e7-87db4aa3320e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:41 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Volume a52214a6-c49f-424a-8914-36fbb1e0ca87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a52214a6-c49f-424a-8914-36fbb1e0ca87', 'volume_size': 1} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:41 devstack sudo[96947]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" returned: 0 in 0.735s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] <== create_volume: return (1780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.783s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.424s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:07:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1440003600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a52214a6-c49f-424a-8914-36fbb1e0ca87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec38f289c25142c1a62c63608dcf0cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:07:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:07:41Z,use_quota=True,user_id='4e39e88da70a41b497347e00a5c2574c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Creating volume a52214a6-c49f-424a-8914-36fbb1e0ca87 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:07:41 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a52214a6-c49f-424a-8914-36fbb1e0ca87 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:41 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a" returned: 0 in 0.836s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.98cb392c-0a4c-45dc-8764-db26f4502406 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:41 devstack sudo[96960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a52214a6-c49f-424a-8914-36fbb1e0ca87 1073741824 Jul 09 10:07:41 devstack sudo[96960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f07db8d0-52ea-4331-a209-9b30764841a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e9e5ea-29ea-4277-8edb-d4605d769c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:41 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.98cb392c-0a4c-45dc-8764-db26f4502406 Jul 09 10:07:41 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:41 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Volume volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 (4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2): created successfully Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76e9e5ea-29ea-4277-8edb-d4605d769c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Flow 'volume_create_manager' (512a4daa-e3b2-4d58-b3b2-e210c4600aca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:07:41 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3b33088c-b4a6-4dd1-8019-dfe60938b148 tempest-SnapshotsActionsTest-1159856324 None] Created volume successfully. Jul 09 10:07:42 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.98cb392c-0a4c-45dc-8764-db26f4502406" returned: 0 in 0.772s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.98cb392c-0a4c-45dc-8764-db26f4502406 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:42 devstack sudo[96972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.98cb392c-0a4c-45dc-8764-db26f4502406 Jul 09 10:07:42 devstack sudo[96972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:42 devstack sudo[96960]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a52214a6-c49f-424a-8914-36fbb1e0ca87 1073741824" returned: 0 in 0.836s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a52214a6-c49f-424a-8914-36fbb1e0ca87 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:42 devstack sudo[96974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a52214a6-c49f-424a-8914-36fbb1e0ca87 Jul 09 10:07:42 devstack sudo[96974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f36ebf63-80f1-4998-b92c-60b87d505699 tempest-SnapshotsActionsTest-1159856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:43 devstack sudo[96972]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a.98cb392c-0a4c-45dc-8764-db26f4502406" returned: 0 in 0.711s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-98cb392c-0a4c-45dc-8764-db26f4502406" released by "_delete_snapshot" :: held 3.235s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:07:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a" released by "delete_snapshot" :: held 3.264s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:07:43 devstack sudo[96974]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a52214a6-c49f-424a-8914-36fbb1e0ca87" returned: 0 in 0.716s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:07:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f36ebf63-80f1-4998-b92c-60b87d505699 tempest-SnapshotsActionsTest-1159856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.133s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2ad7567-bdca-499c-83e7-87db4aa3320e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a52214a6-c49f-424a-8914-36fbb1e0ca87', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe5ce65-1bb7-4a1e-80c8-c0843a07ae72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f36ebf63-80f1-4998-b92c-60b87d505699 tempest-SnapshotsActionsTest-1159856324 None] Creating offline snapshot 2d51f088-0840-45e2-a467-7592f717d87d of volume 4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:07:43 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Volume volume-a52214a6-c49f-424a-8914-36fbb1e0ca87 (a52214a6-c49f-424a-8914-36fbb1e0ca87): created successfully Jul 09 10:07:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbe5ce65-1bb7-4a1e-80c8-c0843a07ae72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Flow 'volume_create_manager' (8f1ab50e-f6f3-465f-980a-0ccc47806ac9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:07:43 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d595dd4-f7fc-4521-b0db-d6c01ce2a098]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:07:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f36ebf63-80f1-4998-b92c-60b87d505699 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:43 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] Created reservations ['1ae46332-de36-41a0-b38b-009fd55d2189', '7f0c1ad6-eb53-415d-a2f6-26874dc33ed3', '22d4649b-8b7a-48e7-ba7c-db2998edc44f', 'c209b85e-c667-472f-9c07-25f5d9b29107'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:07:43 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-134c0f51-878c-4672-a0c9-444e1cfcf698 tempest-AttachVolumeNegativeTest-2008901733 None] Created volume successfully. Jul 09 10:07:43 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] Delete snapshot completed successfully. Jul 09 10:07:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d33daf8a-58df-4d63-8a70-afdd81f51cb9 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-98cb392c-0a4c-45dc-8764-db26f4502406-delete_snapshot" released by "delete_snapshot" :: held 3.509s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:07:43 devstack sudo[96978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 Jul 09 10:07:43 devstack sudo[96978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:44 devstack sudo[96978]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f36ebf63-80f1-4998-b92c-60b87d505699 tempest-SnapshotsActionsTest-1159856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" returned: 0 in 0.796s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f36ebf63-80f1-4998-b92c-60b87d505699 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:44 devstack sudo[96987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d 1G Jul 09 10:07:44 devstack sudo[96987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:44 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:07:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Flow 'volume_create_manager' (068d29e3-fe8d-49f7-bb49-e75c9a6548aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:07:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b7f200-35ce-4830-ae7e-39a055440b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2b7f200-35ce-4830-ae7e-39a055440b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1376507984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0062973c-f9c4-4348-868c-61c020e58621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881b76c1042a4098baf5421bcbe001bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:07:45Z,use_quota=True,user_id='92298f2eb1c84c37bf70ad8de84230f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0aff207-16ff-4c6c-9aa1-84e9b54d62b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0aff207-16ff-4c6c-9aa1-84e9b54d62b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036d0d62-c592-465b-a3e6-d470267e0500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (036d0d62-c592-465b-a3e6-d470267e0500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0062973c-f9c4-4348-868c-61c020e58621', 'volume_name': 'volume-0062973c-f9c4-4348-868c-61c020e58621', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71bdc79b-458e-4ec9-93bd-8d1299654eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71bdc79b-458e-4ec9-93bd-8d1299654eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a163d80-a7f8-4f73-9fde-d84de9f11183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:44 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Volume 0062973c-f9c4-4348-868c-61c020e58621: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0062973c-f9c4-4348-868c-61c020e58621', 'volume_size': 1} Jul 09 10:07:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:45 devstack sudo[96987]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f36ebf63-80f1-4998-b92c-60b87d505699 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d 1G" returned: 0 in 0.892s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f36ebf63-80f1-4998-b92c-60b87d505699 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:45 devstack sudo[97000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d Jul 09 10:07:45 devstack sudo[97000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:45 devstack sudo[97000]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f36ebf63-80f1-4998-b92c-60b87d505699 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d" returned: 0 in 0.676s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:45 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-f36ebf63-80f1-4998-b92c-60b87d505699 tempest-SnapshotsActionsTest-1159856324 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d is being set with open permissions: ugo+rw Jul 09 10:07:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f36ebf63-80f1-4998-b92c-60b87d505699 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:45 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d Jul 09 10:07:45 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:46 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f36ebf63-80f1-4998-b92c-60b87d505699 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d" returned: 0 in 0.632s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f36ebf63-80f1-4998-b92c-60b87d505699 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:46 devstack sudo[97008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.info Jul 09 10:07:46 devstack sudo[97008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:47 devstack sudo[97008]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f36ebf63-80f1-4998-b92c-60b87d505699 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.info" returned: 0 in 0.722s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:47 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-f36ebf63-80f1-4998-b92c-60b87d505699 tempest-SnapshotsActionsTest-1159856324 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.info is being set with open permissions: ugo+rw Jul 09 10:07:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f36ebf63-80f1-4998-b92c-60b87d505699 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:47 devstack sudo[97011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.info Jul 09 10:07:47 devstack sudo[97011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-ce676de4-c72f-4d84-a30f-1ea806a888ca req-3cc951ab-b75e-4afa-9e19-b62e01e2ca04 tempest-AttachVolumeNegativeTest-2008901733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-1781f97a-6503-4d11-8f05-0bb9c1ebda5b req-75b28cbc-d0a2-434a-90a2-9b405514cfd2 tempest-TestInstancesWithCinderVolumes-144069202 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:47 devstack sudo[97011]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f36ebf63-80f1-4998-b92c-60b87d505699 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.info" returned: 0 in 0.628s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f36ebf63-80f1-4998-b92c-60b87d505699 tempest-SnapshotsActionsTest-1159856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.455s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.986s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:07:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1376507984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0062973c-f9c4-4348-868c-61c020e58621,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881b76c1042a4098baf5421bcbe001bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:07:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:07:45Z,use_quota=True,user_id='92298f2eb1c84c37bf70ad8de84230f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:07:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Creating volume 0062973c-f9c4-4348-868c-61c020e58621 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:07:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:07:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:07:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:07:47 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:07:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:47 devstack sudo[97031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 1073741824 Jul 09 10:07:47 devstack sudo[97031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f36ebf63-80f1-4998-b92c-60b87d505699 tempest-SnapshotsActionsTest-1159856324 None] Create snapshot completed successfully Jul 09 10:07:48 devstack sudo[97031]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 1073741824" returned: 0 in 0.782s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:48 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 Jul 09 10:07:48 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:49 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621" returned: 0 in 0.635s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] <== create_volume: return (1453ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:07:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.456s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-ce676de4-c72f-4d84-a30f-1ea806a888ca req-3cc951ab-b75e-4afa-9e19-b62e01e2ca04 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.754s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a163d80-a7f8-4f73-9fde-d84de9f11183) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0062973c-f9c4-4348-868c-61c020e58621', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176f24f8-3de8-479c-81c3-97b56583720e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:49 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cb36fb2-3119-4f42-a896-c15172c99094]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:07:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-ce676de4-c72f-4d84-a30f-1ea806a888ca req-3cc951ab-b75e-4afa-9e19-b62e01e2ca04 tempest-AttachVolumeNegativeTest-2008901733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a52214a6-c49f-424a-8914-36fbb1e0ca87 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:49 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Volume volume-0062973c-f9c4-4348-868c-61c020e58621 (0062973c-f9c4-4348-868c-61c020e58621): created successfully Jul 09 10:07:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (176f24f8-3de8-479c-81c3-97b56583720e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Flow 'volume_create_manager' (068d29e3-fe8d-49f7-bb49-e75c9a6548aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:07:49 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-671c15b6-caa9-49aa-b7f4-7bed1e6255dc tempest-VolumesSnapshotTestJSON-321199851 None] Created volume successfully. Jul 09 10:07:49 devstack sudo[97040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a52214a6-c49f-424a-8914-36fbb1e0ca87 Jul 09 10:07:49 devstack sudo[97040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:50 devstack sudo[97040]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-ce676de4-c72f-4d84-a30f-1ea806a888ca req-3cc951ab-b75e-4afa-9e19-b62e01e2ca04 tempest-AttachVolumeNegativeTest-2008901733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a52214a6-c49f-424a-8914-36fbb1e0ca87" returned: 0 in 0.736s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-ce676de4-c72f-4d84-a30f-1ea806a888ca req-3cc951ab-b75e-4afa-9e19-b62e01e2ca04 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.760s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-1781f97a-6503-4d11-8f05-0bb9c1ebda5b req-75b28cbc-d0a2-434a-90a2-9b405514cfd2 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.372s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:50 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[df66c177-79b0-42cc-8907-88de4637d5e1]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:07:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-1781f97a-6503-4d11-8f05-0bb9c1ebda5b req-75b28cbc-d0a2-434a-90a2-9b405514cfd2 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-96c90d3e-889b-4d38-b527-aa1717226b29 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-ce676de4-c72f-4d84-a30f-1ea806a888ca req-3cc951ab-b75e-4afa-9e19-b62e01e2ca04 tempest-AttachVolumeNegativeTest-2008901733 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-a52214a6-c49f-424a-8914-36fbb1e0ca87', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17cd836f-ef50-44a3-92bf-3d0746e9c058', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:07:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-ce676de4-c72f-4d84-a30f-1ea806a888ca req-3cc951ab-b75e-4afa-9e19-b62e01e2ca04 tempest-AttachVolumeNegativeTest-2008901733 None] attachment_update completed successfully. Jul 09 10:07:50 devstack sudo[97045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-96c90d3e-889b-4d38-b527-aa1717226b29 Jul 09 10:07:50 devstack sudo[97045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:50 devstack sudo[97045]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-1781f97a-6503-4d11-8f05-0bb9c1ebda5b req-75b28cbc-d0a2-434a-90a2-9b405514cfd2 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-96c90d3e-889b-4d38-b527-aa1717226b29" returned: 0 in 0.761s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-1781f97a-6503-4d11-8f05-0bb9c1ebda5b req-75b28cbc-d0a2-434a-90a2-9b405514cfd2 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.778s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-1781f97a-6503-4d11-8f05-0bb9c1ebda5b req-75b28cbc-d0a2-434a-90a2-9b405514cfd2 tempest-TestInstancesWithCinderVolumes-144069202 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-96c90d3e-889b-4d38-b527-aa1717226b29', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '04a52e73-fede-4c25-bc23-bda48126d29f', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:07:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9a0c8912-a11e-440f-8bff-200cee49eeca tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9a0c8912-a11e-440f-8bff-200cee49eeca tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9a0c8912-a11e-440f-8bff-200cee49eeca tempest-VolumesSnapshotTestJSON-321199851 None] Creating offline snapshot 575ada82-047e-4c29-80c9-7e2a92e39d73 of volume 0062973c-f9c4-4348-868c-61c020e58621 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:07:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-1781f97a-6503-4d11-8f05-0bb9c1ebda5b req-75b28cbc-d0a2-434a-90a2-9b405514cfd2 tempest-TestInstancesWithCinderVolumes-144069202 None] attachment_update completed successfully. Jul 09 10:07:50 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d90c167-e29e-42c8-a697-eb07f591e949]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:07:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a0c8912-a11e-440f-8bff-200cee49eeca tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:51 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 Jul 09 10:07:51 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cb6c5545-87f9-4205-a20f-19f4dca0e6c8 tempest-SnapshotsActionsTest-1159856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:51 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a0c8912-a11e-440f-8bff-200cee49eeca tempest-VolumesSnapshotTestJSON-321199851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621" returned: 0 in 0.906s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a0c8912-a11e-440f-8bff-200cee49eeca tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:51 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73 1G Jul 09 10:07:51 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:52 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a0c8912-a11e-440f-8bff-200cee49eeca tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73 1G" returned: 0 in 0.789s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a0c8912-a11e-440f-8bff-200cee49eeca tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0062973c-f9c4-4348-868c-61c020e58621 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:52 devstack sudo[97065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0062973c-f9c4-4348-868c-61c020e58621 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73 Jul 09 10:07:52 devstack sudo[97065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:53 devstack sudo[97065]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a0c8912-a11e-440f-8bff-200cee49eeca tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0062973c-f9c4-4348-868c-61c020e58621 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73" returned: 0 in 0.674s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:53 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-9a0c8912-a11e-440f-8bff-200cee49eeca tempest-VolumesSnapshotTestJSON-321199851 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73 is being set with open permissions: ugo+rw Jul 09 10:07:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a0c8912-a11e-440f-8bff-200cee49eeca tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:53 devstack sudo[97070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73 Jul 09 10:07:53 devstack sudo[97070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:53 devstack sudo[97070]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a0c8912-a11e-440f-8bff-200cee49eeca tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73" returned: 0 in 0.646s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a0c8912-a11e-440f-8bff-200cee49eeca tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:54 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.info Jul 09 10:07:54 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:54 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a0c8912-a11e-440f-8bff-200cee49eeca tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.info" returned: 0 in 0.650s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:54 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-9a0c8912-a11e-440f-8bff-200cee49eeca tempest-VolumesSnapshotTestJSON-321199851 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.info is being set with open permissions: ugo+rw Jul 09 10:07:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a0c8912-a11e-440f-8bff-200cee49eeca tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:54 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.info Jul 09 10:07:54 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:55 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a0c8912-a11e-440f-8bff-200cee49eeca tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.info" returned: 0 in 0.665s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9a0c8912-a11e-440f-8bff-200cee49eeca tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.419s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cb6c5545-87f9-4205-a20f-19f4dca0e6c8 tempest-SnapshotsActionsTest-1159856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.925s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-cb6c5545-87f9-4205-a20f-19f4dca0e6c8 tempest-SnapshotsActionsTest-1159856324 None] Creating offline snapshot 465f8f60-512a-483c-b5ad-7111100c315e of volume 4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:07:55 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[76f7959b-03ac-4968-a5a5-68468308a9f0]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:07:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cb6c5545-87f9-4205-a20f-19f4dca0e6c8 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9a0c8912-a11e-440f-8bff-200cee49eeca tempest-VolumesSnapshotTestJSON-321199851 None] Create snapshot completed successfully Jul 09 10:07:55 devstack sudo[97087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d Jul 09 10:07:55 devstack sudo[97087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:56 devstack sudo[97087]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cb6c5545-87f9-4205-a20f-19f4dca0e6c8 tempest-SnapshotsActionsTest-1159856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d" returned: 0 in 0.819s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-cb6c5545-87f9-4205-a20f-19f4dca0e6c8 tempest-SnapshotsActionsTest-1159856324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:07:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cb6c5545-87f9-4205-a20f-19f4dca0e6c8 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.465f8f60-512a-483c-b5ad-7111100c315e 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:56 devstack sudo[97092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.465f8f60-512a-483c-b5ad-7111100c315e 1G Jul 09 10:07:56 devstack sudo[97092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:56 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:07:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Flow 'volume_create_manager' (dc146bd5-52e9-484a-8ee4-69da2da251d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:07:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c230ddb-7b65-4fa8-9aa3-32d4a36b2041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3c230ddb-7b65-4fa8-9aa3-32d4a36b2041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:07:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-363848633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d84be84f-79ab-4518-8ccf-b47c509f42d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881b76c1042a4098baf5421bcbe001bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:07:57Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=575ada82-047e-4c29-80c9-7e2a92e39d73,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:07:57Z,use_quota=True,user_id='92298f2eb1c84c37bf70ad8de84230f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aac59f0-94f9-4e55-a852-c2d2ea5ec8a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5aac59f0-94f9-4e55-a852-c2d2ea5ec8a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0de5cd6-1c41-4004-9116-d2e122c49287) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0de5cd6-1c41-4004-9116-d2e122c49287) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd84be84f-79ab-4518-8ccf-b47c509f42d9', 'volume_name': 'volume-d84be84f-79ab-4518-8ccf-b47c509f42d9', 'volume_size': 2, 'snapshot_id': '575ada82-047e-4c29-80c9-7e2a92e39d73'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (706f5166-29c2-4f30-b609-44ea081aa9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (706f5166-29c2-4f30-b609-44ea081aa9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:07:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f2e255-b798-4039-ab11-09e561b464ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:07:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Volume d84be84f-79ab-4518-8ccf-b47c509f42d9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d84be84f-79ab-4518-8ccf-b47c509f42d9', 'volume_size': 2, 'snapshot_id': '575ada82-047e-4c29-80c9-7e2a92e39d73'} Jul 09 10:07:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-7bded167-5b58-4ed1-bba7-8fd001924051 req-3c98228e-bb3d-4636-bf00-d0df7a37e2d1 tempest-AttachVolumeNegativeTest-2008901733 None] Terminate volume connection completed successfully. Jul 09 10:07:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-7bded167-5b58-4ed1-bba7-8fd001924051 req-3c98228e-bb3d-4636-bf00-d0df7a37e2d1 tempest-AttachVolumeNegativeTest-2008901733 None] Deleting attachment 17cd836f-ef50-44a3-92bf-3d0746e9c058. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:07:57 devstack sudo[97092]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cb6c5545-87f9-4205-a20f-19f4dca0e6c8 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.465f8f60-512a-483c-b5ad-7111100c315e 1G" returned: 0 in 1.039s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cb6c5545-87f9-4205-a20f-19f4dca0e6c8 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.465f8f60-512a-483c-b5ad-7111100c315e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:57 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.465f8f60-512a-483c-b5ad-7111100c315e Jul 09 10:07:57 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:57 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cb6c5545-87f9-4205-a20f-19f4dca0e6c8 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.465f8f60-512a-483c-b5ad-7111100c315e" returned: 0 in 0.734s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:58 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-cb6c5545-87f9-4205-a20f-19f4dca0e6c8 tempest-SnapshotsActionsTest-1159856324 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.465f8f60-512a-483c-b5ad-7111100c315e is being set with open permissions: ugo+rw Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cb6c5545-87f9-4205-a20f-19f4dca0e6c8 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.465f8f60-512a-483c-b5ad-7111100c315e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:58 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.465f8f60-512a-483c-b5ad-7111100c315e Jul 09 10:07:58 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:58 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cb6c5545-87f9-4205-a20f-19f4dca0e6c8 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.465f8f60-512a-483c-b5ad-7111100c315e" returned: 0 in 0.674s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cb6c5545-87f9-4205-a20f-19f4dca0e6c8 tempest-SnapshotsActionsTest-1159856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.381s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.668s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-quobyte-575ada82-047e-4c29-80c9-7e2a92e39d73-d84be84f-79ab-4518-8ccf-b47c509f42d9" by "_create_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-575ada82-047e-4c29-80c9-7e2a92e39d73-d84be84f-79ab-4518-8ccf-b47c509f42d9" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Creating volume d84be84f-79ab-4518-8ccf-b47c509f42d9 from snapshot 575ada82-047e-4c29-80c9-7e2a92e39d73 {{(pid=87192) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-quobyte-d84be84f-79ab-4518-8ccf-b47c509f42d9" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:07:58 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-cb6c5545-87f9-4205-a20f-19f4dca0e6c8 tempest-SnapshotsActionsTest-1159856324 None] Create snapshot completed successfully Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-d84be84f-79ab-4518-8ccf-b47c509f42d9" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] snapshot: 575ada82-047e-4c29-80c9-7e2a92e39d73, volume: d84be84f-79ab-4518-8ccf-b47c509f42d9, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc109aeb-fe0e-4646-a75d-3e96342556fb]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:07:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:58 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73 Jul 09 10:07:58 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:59 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Jul 09 10:07:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73" returned: 0 in 0.777s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:07:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0062973c-f9c4-4348-868c-61c020e58621(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:07:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 10:07:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 10:07:59 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fbc16c3-00cf-4b8e-9782-9f2a1821cd8a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:07:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:07:59 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 Jul 09 10:07:59 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:07:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] Acquiring lock "cinder-465f8f60-512a-483c-b5ad-7111100c315e-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:07:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-465f8f60-512a-483c-b5ad-7111100c315e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:07:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] Acquiring lock "cinder-quobyte-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:07:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-quobyte-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:07:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] Acquiring lock "cinder-quobyte-465f8f60-512a-483c-b5ad-7111100c315e" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:07:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-quobyte-465f8f60-512a-483c-b5ad-7111100c315e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:07:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] Deleting offline snapshot 465f8f60-512a-483c-b5ad-7111100c315e of volume 4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:07:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] snapshot_file for this snap is: volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.465f8f60-512a-483c-b5ad-7111100c315e {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:07:59 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce0c738-4f73-41fe-ba69-6ab5ce18b67e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:07:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.465f8f60-512a-483c-b5ad-7111100c315e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-f5cec2db-5882-48b9-98a0-4b9957d27aaa req-9a561ab8-d965-4ba0-9283-d50b4e442fa1 tempest-TestInstancesWithCinderVolumes-144069202 None] Terminate volume connection completed successfully. Jul 09 10:08:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-f5cec2db-5882-48b9-98a0-4b9957d27aaa req-9a561ab8-d965-4ba0-9283-d50b4e442fa1 tempest-TestInstancesWithCinderVolumes-144069202 None] Deleting attachment 789f6dd4-f57c-4f1d-9cbb-e6a1c194ca09. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:08:00 devstack sudo[97143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.465f8f60-512a-483c-b5ad-7111100c315e Jul 09 10:08:00 devstack sudo[97143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:00 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621" returned: 0 in 0.824s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:00 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Path /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d84be84f-79ab-4518-8ccf-b47c509f42d9 not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 10:08:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d84be84f-79ab-4518-8ccf-b47c509f42d9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:00 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d84be84f-79ab-4518-8ccf-b47c509f42d9 Jul 09 10:08:00 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:00 devstack sudo[97143]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.465f8f60-512a-483c-b5ad-7111100c315e" returned: 0 in 0.804s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:08:00 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c52cd5fc-bba0-46dc-973b-46d7700629ad]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:01 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d Jul 09 10:08:01 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] Acquiring lock "cinder-702c3c2e-9669-4ec8-8131-7957b3e47ec0-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "cinder-702c3c2e-9669-4ec8-8131-7957b3e47ec0-delete_volume" acquired by "delete_volume" :: waited 0.061s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:02 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d" returned: 0 in 1.513s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:08:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.465f8f60-512a-483c-b5ad-7111100c315e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] Acquiring lock "cinder-quobyte-702c3c2e-9669-4ec8-8131-7957b3e47ec0" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:02 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.465f8f60-512a-483c-b5ad-7111100c315e Jul 09 10:08:02 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "cinder-quobyte-702c3c2e-9669-4ec8-8131-7957b3e47ec0" acquired by "delete_volume" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb305275-bd66-4792-95f7-c621d9496b43]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-702c3c2e-9669-4ec8-8131-7957b3e47ec0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:02 devstack sudo[97198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-702c3c2e-9669-4ec8-8131-7957b3e47ec0 Jul 09 10:08:02 devstack sudo[97198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:04 devstack sudo[97198]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-702c3c2e-9669-4ec8-8131-7957b3e47ec0" returned: 0 in 2.203s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-702c3c2e-9669-4ec8-8131-7957b3e47ec0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:04 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-702c3c2e-9669-4ec8-8131-7957b3e47ec0 Jul 09 10:08:04 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:05 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.465f8f60-512a-483c-b5ad-7111100c315e" returned: 0 in 2.920s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.465f8f60-512a-483c-b5ad-7111100c315e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:05 devstack sudo[97213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.465f8f60-512a-483c-b5ad-7111100c315e Jul 09 10:08:05 devstack sudo[97213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:06 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-702c3c2e-9669-4ec8-8131-7957b3e47ec0" returned: 0 in 1.956s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "cinder-quobyte-702c3c2e-9669-4ec8-8131-7957b3e47ec0" released by "delete_volume" :: held 4.288s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:06 devstack cinder-volume[87192]: WARNING cinder.quota [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1639201820-1906937398 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1639201820-1906937398, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:08:06 devstack cinder-volume[87192]: WARNING cinder.quota [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1639201820-1906937398 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1639201820-1906937398, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:08:06 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] Created reservations ['ee65bc76-11cf-4768-9f8f-3cbaef16e837', 'a5407e8c-a0cd-4127-8753-dbb2523f97b6', '6772dee9-328e-4add-9336-b10912bf58fa', 'd4dff135-79fc-40c1-89de-4e7ca28a7198'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:08:07 devstack sudo[97213]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.465f8f60-512a-483c-b5ad-7111100c315e" returned: 0 in 1.751s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-quobyte-465f8f60-512a-483c-b5ad-7111100c315e" released by "_delete_snapshot" :: held 7.185s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-quobyte-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" released by "delete_snapshot" :: held 7.235s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:08:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:08:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:07 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:08:07 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:07 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] Created reservations ['1df49c49-f18f-4de4-a843-832048356f4a', '09068966-6aa7-4df0-a85c-92347a9189b9', 'a691533e-bfb0-44b6-8c1f-6cee1b77807e', 'c0faec4e-db10-4e9d-bcb3-fe16bb48dfc9'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:08:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] Delete snapshot completed successfully. Jul 09 10:08:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-71535235-9d12-4caf-8fb1-63cf443cdd8f tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-465f8f60-512a-483c-b5ad-7111100c315e-delete_snapshot" released by "delete_snapshot" :: held 7.677s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d84be84f-79ab-4518-8ccf-b47c509f42d9" returned: 0 in 7.210s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:07 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0329d32c-0823-4d0a-801e-6083725b41ea]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:07 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 Jul 09 10:08:07 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:08 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.764s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:08 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:08:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] Deleted volume successfully. Jul 09 10:08:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f90faeba-7752-411e-8dfc-c9534d093dea tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "cinder-702c3c2e-9669-4ec8-8131-7957b3e47ec0-delete_volume" released by "delete_volume" :: held 5.873s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:08 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621" returned: 0 in 0.978s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:08 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Image conversion details: src /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621, size 1024.00 MB, duration 7.21 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d84be84f-79ab-4518-8ccf-b47c509f42d9 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:08:08 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Converted 1024.00 MB image at 142.01 MB/s Jul 09 10:08:08 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d84be84f-79ab-4518-8ccf-b47c509f42d9 is being set with open permissions: ugo+rw Jul 09 10:08:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d84be84f-79ab-4518-8ccf-b47c509f42d9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:08 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d84be84f-79ab-4518-8ccf-b47c509f42d9 Jul 09 10:08:08 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-475840da-3490-4d66-8aaf-a5bd02ac6976 tempest-SnapshotsActionsTest-1159856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:09 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-3aad6dcc-0692-4d1f-9624-6723d1109825 req-41168066-c1d0-403e-91aa-991653e7ef80 tempest-TestInstancesWithCinderVolumes-144069202 None] Terminate volume connection completed successfully. Jul 09 10:08:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-3aad6dcc-0692-4d1f-9624-6723d1109825 req-41168066-c1d0-403e-91aa-991653e7ef80 tempest-TestInstancesWithCinderVolumes-144069202 None] Deleting attachment 04a52e73-fede-4c25-bc23-bda48126d29f. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:08:09 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d84be84f-79ab-4518-8ccf-b47c509f42d9" returned: 0 in 0.688s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-d84be84f-79ab-4518-8ccf-b47c509f42d9" released by "_copy_volume_from_snapshot" :: held 10.570s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-575ada82-047e-4c29-80c9-7e2a92e39d73-d84be84f-79ab-4518-8ccf-b47c509f42d9" released by "_create_volume_from_snapshot" :: held 10.602s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.620s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-475840da-3490-4d66-8aaf-a5bd02ac6976 tempest-SnapshotsActionsTest-1159856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.406s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-475840da-3490-4d66-8aaf-a5bd02ac6976 tempest-SnapshotsActionsTest-1159856324 None] Creating offline snapshot 62135d4a-e2fc-4aae-8261-9b27551a4f50 of volume 4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:08:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52f2e255-b798-4039-ab11-09e561b464ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d84be84f-79ab-4518-8ccf-b47c509f42d9', 'volume_size': 2, 'snapshot_id': '575ada82-047e-4c29-80c9-7e2a92e39d73'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:08:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddac0469-a09a-4f02-bf42-db0c6bfaffe1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:08:09 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad422fa-e4fc-4f9e-a768-35e816c5e4bd]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-475840da-3490-4d66-8aaf-a5bd02ac6976 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:09 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Volume volume-d84be84f-79ab-4518-8ccf-b47c509f42d9 (d84be84f-79ab-4518-8ccf-b47c509f42d9): created successfully Jul 09 10:08:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddac0469-a09a-4f02-bf42-db0c6bfaffe1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:08:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Flow 'volume_create_manager' (dc146bd5-52e9-484a-8ee4-69da2da251d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:08:09 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-08b87617-a413-4480-ae39-182a2ad8f5e8 tempest-VolumesSnapshotTestJSON-321199851 None] Created volume successfully. Jul 09 10:08:09 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d Jul 09 10:08:09 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:10 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-475840da-3490-4d66-8aaf-a5bd02ac6976 tempest-SnapshotsActionsTest-1159856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d" returned: 0 in 0.814s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-475840da-3490-4d66-8aaf-a5bd02ac6976 tempest-SnapshotsActionsTest-1159856324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:08:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-475840da-3490-4d66-8aaf-a5bd02ac6976 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.62135d4a-e2fc-4aae-8261-9b27551a4f50 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55244dfa-a08b-4269-94a4-db4ae387d774 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-d84be84f-79ab-4518-8ccf-b47c509f42d9-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:10 devstack sudo[97256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.62135d4a-e2fc-4aae-8261-9b27551a4f50 1G Jul 09 10:08:10 devstack sudo[97256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55244dfa-a08b-4269-94a4-db4ae387d774 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-d84be84f-79ab-4518-8ccf-b47c509f42d9-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55244dfa-a08b-4269-94a4-db4ae387d774 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-quobyte-d84be84f-79ab-4518-8ccf-b47c509f42d9" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55244dfa-a08b-4269-94a4-db4ae387d774 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-d84be84f-79ab-4518-8ccf-b47c509f42d9" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:10 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8107855d-cdea-4719-9730-487af7ab1cb4]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55244dfa-a08b-4269-94a4-db4ae387d774 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d84be84f-79ab-4518-8ccf-b47c509f42d9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:10 devstack sudo[97258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d84be84f-79ab-4518-8ccf-b47c509f42d9 Jul 09 10:08:10 devstack sudo[97258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] Acquiring lock "cinder-96c90d3e-889b-4d38-b527-aa1717226b29-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "cinder-96c90d3e-889b-4d38-b527-aa1717226b29-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] Acquiring lock "cinder-quobyte-96c90d3e-889b-4d38-b527-aa1717226b29" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "cinder-quobyte-96c90d3e-889b-4d38-b527-aa1717226b29" acquired by "delete_volume" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:11 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dc01390-3296-4f02-9a11-35264cf77be7]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-96c90d3e-889b-4d38-b527-aa1717226b29 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:11 devstack sudo[97256]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-475840da-3490-4d66-8aaf-a5bd02ac6976 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.62135d4a-e2fc-4aae-8261-9b27551a4f50 1G" returned: 0 in 1.148s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-475840da-3490-4d66-8aaf-a5bd02ac6976 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.62135d4a-e2fc-4aae-8261-9b27551a4f50 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:11 devstack sudo[97258]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:11 devstack sudo[97267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-96c90d3e-889b-4d38-b527-aa1717226b29 Jul 09 10:08:11 devstack sudo[97267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55244dfa-a08b-4269-94a4-db4ae387d774 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d84be84f-79ab-4518-8ccf-b47c509f42d9" returned: 0 in 1.055s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55244dfa-a08b-4269-94a4-db4ae387d774 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d84be84f-79ab-4518-8ccf-b47c509f42d9 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:11 devstack sudo[97268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.62135d4a-e2fc-4aae-8261-9b27551a4f50 Jul 09 10:08:11 devstack sudo[97268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:11 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d84be84f-79ab-4518-8ccf-b47c509f42d9 Jul 09 10:08:11 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:12 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55244dfa-a08b-4269-94a4-db4ae387d774 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d84be84f-79ab-4518-8ccf-b47c509f42d9" returned: 0 in 1.001s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:12 devstack sudo[97267]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-96c90d3e-889b-4d38-b527-aa1717226b29" returned: 0 in 1.220s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-96c90d3e-889b-4d38-b527-aa1717226b29 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55244dfa-a08b-4269-94a4-db4ae387d774 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-d84be84f-79ab-4518-8ccf-b47c509f42d9" released by "delete_volume" :: held 2.135s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:12 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-96c90d3e-889b-4d38-b527-aa1717226b29 Jul 09 10:08:12 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:12 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-55244dfa-a08b-4269-94a4-db4ae387d774 tempest-VolumesSnapshotTestJSON-321199851 None] Created reservations ['de9b0428-53ea-4d21-84d4-5033b741b7e2', '56ca0af1-6349-4c74-b824-9a0449caddbc', '3b7f9fcc-e036-4152-af33-29f8f8a5720e', '222e9b5d-d8af-40f3-890f-f34cb55b467a'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:08:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-55244dfa-a08b-4269-94a4-db4ae387d774 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-55244dfa-a08b-4269-94a4-db4ae387d774 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-55244dfa-a08b-4269-94a4-db4ae387d774 tempest-VolumesSnapshotTestJSON-321199851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:08:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-55244dfa-a08b-4269-94a4-db4ae387d774 tempest-VolumesSnapshotTestJSON-321199851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:08:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-55244dfa-a08b-4269-94a4-db4ae387d774 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55244dfa-a08b-4269-94a4-db4ae387d774 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:12 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:08:12 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:12 devstack sudo[97268]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-475840da-3490-4d66-8aaf-a5bd02ac6976 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.62135d4a-e2fc-4aae-8261-9b27551a4f50" returned: 0 in 1.420s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:12 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-475840da-3490-4d66-8aaf-a5bd02ac6976 tempest-SnapshotsActionsTest-1159856324 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.62135d4a-e2fc-4aae-8261-9b27551a4f50 is being set with open permissions: ugo+rw Jul 09 10:08:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-475840da-3490-4d66-8aaf-a5bd02ac6976 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.62135d4a-e2fc-4aae-8261-9b27551a4f50 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:12 devstack sudo[97285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.62135d4a-e2fc-4aae-8261-9b27551a4f50 Jul 09 10:08:12 devstack sudo[97285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:13 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-96c90d3e-889b-4d38-b527-aa1717226b29" returned: 0 in 0.884s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "cinder-quobyte-96c90d3e-889b-4d38-b527-aa1717226b29" released by "delete_volume" :: held 2.181s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:13 devstack cinder-volume[87192]: WARNING cinder.quota [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-353196136-494768116 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-353196136-494768116, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:08:13 devstack cinder-volume[87192]: WARNING cinder.quota [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-353196136-494768116 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-353196136-494768116, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] Created reservations ['db05d2d8-f6c7-4c6f-b285-a751288a285e', '8599786c-ad3c-49b5-babe-97c4e7603787', 'a11c264a-d57c-40dc-bcfc-5d650fc837c5', 'e2f896f2-0d72-4087-8aac-f9925786fd56'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:13 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:08:13 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:13 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55244dfa-a08b-4269-94a4-db4ae387d774 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.986s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-55244dfa-a08b-4269-94a4-db4ae387d774 tempest-VolumesSnapshotTestJSON-321199851 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:08:13 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-55244dfa-a08b-4269-94a4-db4ae387d774 tempest-VolumesSnapshotTestJSON-321199851 None] Deleted volume successfully. Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55244dfa-a08b-4269-94a4-db4ae387d774 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-d84be84f-79ab-4518-8ccf-b47c509f42d9-delete_volume" released by "delete_volume" :: held 3.469s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-575ada82-047e-4c29-80c9-7e2a92e39d73-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-575ada82-047e-4c29-80c9-7e2a92e39d73-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-quobyte-0062973c-f9c4-4348-868c-61c020e58621" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-0062973c-f9c4-4348-868c-61c020e58621" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-quobyte-575ada82-047e-4c29-80c9-7e2a92e39d73" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-575ada82-047e-4c29-80c9-7e2a92e39d73" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] Deleting offline snapshot 575ada82-047e-4c29-80c9-7e2a92e39d73 of volume 0062973c-f9c4-4348-868c-61c020e58621 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] snapshot_file for this snap is: volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbaadaa9-5540-49cb-8e89-9d3f98a62518]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:14 devstack sudo[97285]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-475840da-3490-4d66-8aaf-a5bd02ac6976 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.62135d4a-e2fc-4aae-8261-9b27551a4f50" returned: 0 in 1.252s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-475840da-3490-4d66-8aaf-a5bd02ac6976 tempest-SnapshotsActionsTest-1159856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.762s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:14 devstack sudo[97292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73 Jul 09 10:08:14 devstack sudo[97292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-475840da-3490-4d66-8aaf-a5bd02ac6976 tempest-SnapshotsActionsTest-1159856324 None] Create snapshot completed successfully Jul 09 10:08:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] Acquiring lock "cinder-62135d4a-e2fc-4aae-8261-9b27551a4f50-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-62135d4a-e2fc-4aae-8261-9b27551a4f50-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] Acquiring lock "cinder-quobyte-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-quobyte-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" acquired by "delete_snapshot" :: waited 0.049s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] Acquiring lock "cinder-quobyte-62135d4a-e2fc-4aae-8261-9b27551a4f50" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-quobyte-62135d4a-e2fc-4aae-8261-9b27551a4f50" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] Deleting offline snapshot 62135d4a-e2fc-4aae-8261-9b27551a4f50 of volume 4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:08:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] snapshot_file for this snap is: volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.62135d4a-e2fc-4aae-8261-9b27551a4f50 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:08:14 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.039s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:14 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:08:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] Deleted volume successfully. Jul 09 10:08:14 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2bc236fa-2297-4dba-a8d7-1cd644cbbd91]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.62135d4a-e2fc-4aae-8261-9b27551a4f50 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-18a557cb-1882-463e-8fe4-e9a9fa8d02a0 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "cinder-96c90d3e-889b-4d38-b527-aa1717226b29-delete_volume" released by "delete_volume" :: held 3.606s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:14 devstack sudo[97297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.62135d4a-e2fc-4aae-8261-9b27551a4f50 Jul 09 10:08:14 devstack sudo[97297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:15 devstack sudo[97292]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73" returned: 0 in 1.166s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0062973c-f9c4-4348-868c-61c020e58621(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:08:15 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af62124-6294-4d99-9c3d-658056bf527f]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:15 devstack sudo[97305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 Jul 09 10:08:15 devstack sudo[97305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:15 devstack sudo[97297]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.62135d4a-e2fc-4aae-8261-9b27551a4f50" returned: 0 in 1.047s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:08:15 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b600a0e-4bde-47de-8210-d2bf89e8b7a1]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:15 devstack sudo[97310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d Jul 09 10:08:15 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:16 devstack sudo[97305]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621" returned: 0 in 0.921s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:16 devstack sudo[97320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73 Jul 09 10:08:16 devstack sudo[97320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:16 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d" returned: 0 in 0.907s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:08:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.62135d4a-e2fc-4aae-8261-9b27551a4f50 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:16 devstack sudo[97331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.62135d4a-e2fc-4aae-8261-9b27551a4f50 Jul 09 10:08:16 devstack sudo[97331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:17 devstack sudo[97320]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73" returned: 0 in 1.031s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:17 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73 Jul 09 10:08:17 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:17 devstack sudo[97331]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.62135d4a-e2fc-4aae-8261-9b27551a4f50" returned: 0 in 1.108s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.62135d4a-e2fc-4aae-8261-9b27551a4f50 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:17 devstack sudo[97352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.62135d4a-e2fc-4aae-8261-9b27551a4f50 Jul 09 10:08:17 devstack sudo[97352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:17 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621.575ada82-047e-4c29-80c9-7e2a92e39d73" returned: 0 in 0.821s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-575ada82-047e-4c29-80c9-7e2a92e39d73" released by "_delete_snapshot" :: held 4.083s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-0062973c-f9c4-4348-868c-61c020e58621" released by "delete_snapshot" :: held 4.113s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:18 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] Created reservations ['9f39f9a9-0a64-4cda-8126-884b3ba8d164', '13637e63-c7d7-47c7-a73e-4069f921ee5e', '25c32652-d4f0-4922-9aa5-88c9ad809216', '8b7e2949-9168-4a85-aca2-e45f61c5d700'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:08:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] Delete snapshot completed successfully. Jul 09 10:08:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-246cbc95-61c4-4eb8-9912-9a742c29f78a tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-575ada82-047e-4c29-80c9-7e2a92e39d73-delete_snapshot" released by "delete_snapshot" :: held 4.299s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:18 devstack sudo[97352]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.62135d4a-e2fc-4aae-8261-9b27551a4f50" returned: 0 in 0.746s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-quobyte-62135d4a-e2fc-4aae-8261-9b27551a4f50" released by "_delete_snapshot" :: held 3.934s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-quobyte-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" released by "delete_snapshot" :: held 3.975s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:18 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] Created reservations ['5f5e3b96-97a4-49cd-8ee4-adfb98d8bf43', 'fff3dfdd-4d24-43fd-9334-5c4ebe9279f6', '5b1ca001-2b5a-46ea-be2d-b1e9cdc29adf', '7d4e4179-b89a-4399-bd0e-d0e6ec69fd17'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:08:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] Delete snapshot completed successfully. Jul 09 10:08:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-310fb10a-3bf2-4855-8c24-94058ccc42b9 tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-62135d4a-e2fc-4aae-8261-9b27551a4f50-delete_snapshot" released by "delete_snapshot" :: held 4.150s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-79e56a6e-bd65-44a8-9297-89a169abb536 tempest-SnapshotsActionsTest-1159856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-79e56a6e-bd65-44a8-9297-89a169abb536 tempest-SnapshotsActionsTest-1159856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-79e56a6e-bd65-44a8-9297-89a169abb536 tempest-SnapshotsActionsTest-1159856324 None] Creating offline snapshot 59012081-ffcb-4fb1-95fe-e700a64d8287 of volume 4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:08:19 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-a2def4e8-a293-4d52-805a-25fbcd716ff4 req-c2b53d1f-a02c-4f05-a4e0-e75ddcceb384 tempest-TestInstancesWithCinderVolumes-144069202 None] Terminate volume connection completed successfully. Jul 09 10:08:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-a2def4e8-a293-4d52-805a-25fbcd716ff4 req-c2b53d1f-a02c-4f05-a4e0-e75ddcceb384 tempest-TestInstancesWithCinderVolumes-144069202 None] Deleting attachment 11f2583f-4315-4039-aabb-8df9a3a5db31. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:08:19 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcdcd33f-2243-4897-a2f0-77954944f3d0]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79e56a6e-bd65-44a8-9297-89a169abb536 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:19 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d Jul 09 10:08:19 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c0e8f00f-57cd-41c0-a702-b4144c8b3196 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-0062973c-f9c4-4348-868c-61c020e58621-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c0e8f00f-57cd-41c0-a702-b4144c8b3196 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-0062973c-f9c4-4348-868c-61c020e58621-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c0e8f00f-57cd-41c0-a702-b4144c8b3196 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-quobyte-0062973c-f9c4-4348-868c-61c020e58621" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c0e8f00f-57cd-41c0-a702-b4144c8b3196 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-0062973c-f9c4-4348-868c-61c020e58621" acquired by "delete_volume" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:19 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b51d58f4-294b-4cc3-8fe8-b2342731f6a5]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0e8f00f-57cd-41c0-a702-b4144c8b3196 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:19 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 Jul 09 10:08:19 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:19 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79e56a6e-bd65-44a8-9297-89a169abb536 tempest-SnapshotsActionsTest-1159856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d" returned: 0 in 0.912s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-79e56a6e-bd65-44a8-9297-89a169abb536 tempest-SnapshotsActionsTest-1159856324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:08:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79e56a6e-bd65-44a8-9297-89a169abb536 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.59012081-ffcb-4fb1-95fe-e700a64d8287 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:20 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.59012081-ffcb-4fb1-95fe-e700a64d8287 1G Jul 09 10:08:20 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:20 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0e8f00f-57cd-41c0-a702-b4144c8b3196 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621" returned: 0 in 0.878s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0e8f00f-57cd-41c0-a702-b4144c8b3196 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:20 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621 Jul 09 10:08:20 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:21 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79e56a6e-bd65-44a8-9297-89a169abb536 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.59012081-ffcb-4fb1-95fe-e700a64d8287 1G" returned: 0 in 1.024s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79e56a6e-bd65-44a8-9297-89a169abb536 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.59012081-ffcb-4fb1-95fe-e700a64d8287 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:21 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0e8f00f-57cd-41c0-a702-b4144c8b3196 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0062973c-f9c4-4348-868c-61c020e58621" returned: 0 in 0.824s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:21 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.59012081-ffcb-4fb1-95fe-e700a64d8287 Jul 09 10:08:21 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c0e8f00f-57cd-41c0-a702-b4144c8b3196 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-0062973c-f9c4-4348-868c-61c020e58621" released by "delete_volume" :: held 1.791s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:21 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=89,cinder:UPDATE=81,cinder:INSERT=21,cinder:DELETE=10 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:08:21 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=86,cinder:SELECT=108,cinder:INSERT=19,cinder:DELETE=3 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:08:21 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c0e8f00f-57cd-41c0-a702-b4144c8b3196 tempest-VolumesSnapshotTestJSON-321199851 None] Created reservations ['444fc2e7-f6b5-442d-bd71-5ce2c26b0213', '77a3e714-bcf6-4fc5-b960-5ae62b2e3040', '13e33148-5cb5-454f-bba0-c6d4568333d0', 'd7a1a17e-ab74-49c7-9665-664fa4760a7e'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:08:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0e8f00f-57cd-41c0-a702-b4144c8b3196 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0e8f00f-57cd-41c0-a702-b4144c8b3196 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0e8f00f-57cd-41c0-a702-b4144c8b3196 tempest-VolumesSnapshotTestJSON-321199851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:08:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0e8f00f-57cd-41c0-a702-b4144c8b3196 tempest-VolumesSnapshotTestJSON-321199851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:08:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0e8f00f-57cd-41c0-a702-b4144c8b3196 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0e8f00f-57cd-41c0-a702-b4144c8b3196 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:21 devstack sudo[97379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:08:21 devstack sudo[97379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:22 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79e56a6e-bd65-44a8-9297-89a169abb536 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.59012081-ffcb-4fb1-95fe-e700a64d8287" returned: 0 in 1.139s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:22 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-79e56a6e-bd65-44a8-9297-89a169abb536 tempest-SnapshotsActionsTest-1159856324 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.59012081-ffcb-4fb1-95fe-e700a64d8287 is being set with open permissions: ugo+rw Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79e56a6e-bd65-44a8-9297-89a169abb536 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.59012081-ffcb-4fb1-95fe-e700a64d8287 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:22 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.59012081-ffcb-4fb1-95fe-e700a64d8287 Jul 09 10:08:22 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:22 devstack sudo[97379]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Flow 'volume_create_manager' (4b2f567d-fb0b-4c5f-936c-dd0ad5bfd99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49359139-5d00-43aa-9dec-7b8adab2befd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0e8f00f-57cd-41c0-a702-b4144c8b3196 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.155s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-c0e8f00f-57cd-41c0-a702-b4144c8b3196 tempest-VolumesSnapshotTestJSON-321199851 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:08:22 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c0e8f00f-57cd-41c0-a702-b4144c8b3196 tempest-VolumesSnapshotTestJSON-321199851 None] Deleted volume successfully. Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] Acquiring lock "cinder-6aea5e97-4659-4964-a73c-9f80963e7640-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (49359139-5d00-43aa-9dec-7b8adab2befd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1227160549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e46a6d-5bb9-4956-999d-0d041ce887a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881b76c1042a4098baf5421bcbe001bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:08:22Z,use_quota=True,user_id='92298f2eb1c84c37bf70ad8de84230f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b86656b-6414-48f6-91d5-496397e07b43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b86656b-6414-48f6-91d5-496397e07b43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec76247-d764-4b8a-9e6b-a2619817f5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9ec76247-d764-4b8a-9e6b-a2619817f5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0e46a6d-5bb9-4956-999d-0d041ce887a2', 'volume_name': 'volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0252e552-5363-492d-802c-6bdea1bcaec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0252e552-5363-492d-802c-6bdea1bcaec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf81291-75bb-4050-ba9a-1a62b84dfc4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:08:22 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Volume f0e46a6d-5bb9-4956-999d-0d041ce887a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2', 'volume_size': 1} Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "cinder-6aea5e97-4659-4964-a73c-9f80963e7640-delete_volume" acquired by "delete_volume" :: waited 0.084s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c0e8f00f-57cd-41c0-a702-b4144c8b3196 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-0062973c-f9c4-4348-868c-61c020e58621-delete_volume" released by "delete_volume" :: held 3.341s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] Acquiring lock "cinder-quobyte-6aea5e97-4659-4964-a73c-9f80963e7640" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "cinder-quobyte-6aea5e97-4659-4964-a73c-9f80963e7640" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c018a67f-c92e-4b84-9686-598a1e12695a]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:22 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 Jul 09 10:08:22 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:23 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79e56a6e-bd65-44a8-9297-89a169abb536 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.59012081-ffcb-4fb1-95fe-e700a64d8287" returned: 0 in 0.898s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-79e56a6e-bd65-44a8-9297-89a169abb536 tempest-SnapshotsActionsTest-1159856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.071s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.531s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:08:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1227160549',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0e46a6d-5bb9-4956-999d-0d041ce887a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881b76c1042a4098baf5421bcbe001bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:08:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:08:22Z,use_quota=True,user_id='92298f2eb1c84c37bf70ad8de84230f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Creating volume f0e46a6d-5bb9-4956-999d-0d041ce887a2 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:08:23 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:23 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 1073741824 Jul 09 10:08:23 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:23 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-79e56a6e-bd65-44a8-9297-89a169abb536 tempest-SnapshotsActionsTest-1159856324 None] Create snapshot completed successfully Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] Acquiring lock "cinder-59012081-ffcb-4fb1-95fe-e700a64d8287-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-59012081-ffcb-4fb1-95fe-e700a64d8287-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] Acquiring lock "cinder-quobyte-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-quobyte-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] Acquiring lock "cinder-quobyte-59012081-ffcb-4fb1-95fe-e700a64d8287" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-quobyte-59012081-ffcb-4fb1-95fe-e700a64d8287" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] Deleting offline snapshot 59012081-ffcb-4fb1-95fe-e700a64d8287 of volume 4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] snapshot_file for this snap is: volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.59012081-ffcb-4fb1-95fe-e700a64d8287 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[50667e9d-0832-4e68-83a7-7d42c7facee8]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.59012081-ffcb-4fb1-95fe-e700a64d8287 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:23 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640" returned: 0 in 0.865s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:23 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.59012081-ffcb-4fb1-95fe-e700a64d8287 Jul 09 10:08:23 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:23 devstack sudo[97413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 Jul 09 10:08:23 devstack sudo[97413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:24 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 1073741824" returned: 0 in 1.053s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:24 devstack sudo[97421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 Jul 09 10:08:24 devstack sudo[97421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:24 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.59012081-ffcb-4fb1-95fe-e700a64d8287" returned: 0 in 0.926s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:08:24 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[70da5ab1-4701-4185-bb67-394024d851b7]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:24 devstack sudo[97413]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640" returned: 1 in 0.929s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:08:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:24 devstack sudo[97428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640 Jul 09 10:08:24 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:24 devstack sudo[97427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d Jul 09 10:08:24 devstack sudo[97427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:24 devstack sudo[97421]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2" returned: 0 in 0.736s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] <== create_volume: return (1843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:08:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.846s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daf81291-75bb-4050-ba9a-1a62b84dfc4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:08:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b9f8fb-da4e-4cd7-8b32-95f6db1e65c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:08:24 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Volume volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 (f0e46a6d-5bb9-4956-999d-0d041ce887a2): created successfully Jul 09 10:08:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3b9f8fb-da4e-4cd7-8b32-95f6db1e65c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:08:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Flow 'volume_create_manager' (4b2f567d-fb0b-4c5f-936c-dd0ad5bfd99f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:08:25 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ae37560b-0450-4fb2-92dd-9cd27998163e tempest-VolumesSnapshotTestJSON-321199851 None] Created volume successfully. Jul 09 10:08:25 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6aea5e97-4659-4964-a73c-9f80963e7640" returned: 0 in 0.712s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "cinder-quobyte-6aea5e97-4659-4964-a73c-9f80963e7640" released by "delete_volume" :: held 2.583s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:25 devstack cinder-volume[87192]: WARNING cinder.quota [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-407867621-551806669 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-407867621-551806669, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:08:25 devstack cinder-volume[87192]: WARNING cinder.quota [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-407867621-551806669 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-407867621-551806669, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:08:25 devstack sudo[97427]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d" returned: 0 in 0.834s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:08:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.59012081-ffcb-4fb1-95fe-e700a64d8287 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:25 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] Created reservations ['5dc7210d-98f3-49f5-8cc2-24b802fe3d45', '6d6d7daa-4d47-4d50-80c5-cc1be526ad1e', 'ef1ea077-cb6e-409d-9435-d7b3e3c826f2', '5b342af4-a712-4cf2-b85e-0d15b3d94c91'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:08:25 devstack sudo[97436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.59012081-ffcb-4fb1-95fe-e700a64d8287 Jul 09 10:08:25 devstack sudo[97436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:08:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:08:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:25 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:08:25 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-778473e6-f8d2-4edb-a188-abb5846d630a tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-778473e6-f8d2-4edb-a188-abb5846d630a tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-778473e6-f8d2-4edb-a188-abb5846d630a tempest-VolumesSnapshotTestJSON-321199851 None] Creating offline snapshot 8931a496-a604-42c2-b3eb-83a218d9c8b3 of volume f0e46a6d-5bb9-4956-999d-0d041ce887a2 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:08:25 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[33391b7a-e44c-4734-a681-992f4dd81306]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-778473e6-f8d2-4edb-a188-abb5846d630a tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:26 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 Jul 09 10:08:26 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:26 devstack sudo[97436]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.59012081-ffcb-4fb1-95fe-e700a64d8287" returned: 0 in 1.336s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.59012081-ffcb-4fb1-95fe-e700a64d8287 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:26 devstack sudo[97521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.59012081-ffcb-4fb1-95fe-e700a64d8287 Jul 09 10:08:26 devstack sudo[97521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:26 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.308s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:26 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:08:26 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] Deleted volume successfully. Jul 09 10:08:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fae26699-230f-4e50-a8c5-7fd3abd24d86 tempest-TestInstancesWithCinderVolumes-144069202 None] Lock "cinder-6aea5e97-4659-4964-a73c-9f80963e7640-delete_volume" released by "delete_volume" :: held 4.165s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:27 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-778473e6-f8d2-4edb-a188-abb5846d630a tempest-VolumesSnapshotTestJSON-321199851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2" returned: 0 in 1.274s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-778473e6-f8d2-4edb-a188-abb5846d630a tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:27 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3 1G Jul 09 10:08:27 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:27 devstack sudo[97521]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.59012081-ffcb-4fb1-95fe-e700a64d8287" returned: 0 in 0.878s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-quobyte-59012081-ffcb-4fb1-95fe-e700a64d8287" released by "_delete_snapshot" :: held 4.095s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-quobyte-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" released by "delete_snapshot" :: held 4.124s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:27 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] Created reservations ['a415c01b-d397-4ba0-9155-4bbc5d4ff0a4', 'ed6214ab-b063-45f5-af95-22544545b84f', '5a4ab3c2-f22d-4360-ac09-bbb0e7e9e8e9', 'd2a46eda-7460-45b2-a7c5-39b928de8f48'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:08:27 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] Delete snapshot completed successfully. Jul 09 10:08:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8c903f2c-354e-4e0e-9761-c42dbaf99e98 tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-59012081-ffcb-4fb1-95fe-e700a64d8287-delete_snapshot" released by "delete_snapshot" :: held 4.329s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:28 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-778473e6-f8d2-4edb-a188-abb5846d630a tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3 1G" returned: 0 in 1.125s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-778473e6-f8d2-4edb-a188-abb5846d630a tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:28 devstack sudo[97563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3 Jul 09 10:08:28 devstack sudo[97563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:29 devstack sudo[97563]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-778473e6-f8d2-4edb-a188-abb5846d630a tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3" returned: 0 in 0.905s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:29 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-778473e6-f8d2-4edb-a188-abb5846d630a tempest-VolumesSnapshotTestJSON-321199851 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3 is being set with open permissions: ugo+rw Jul 09 10:08:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-778473e6-f8d2-4edb-a188-abb5846d630a tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:29 devstack sudo[97572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3 Jul 09 10:08:29 devstack sudo[97572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-118fbdce-f507-42be-95fd-c8f25108c709 tempest-SnapshotsActionsTest-1159856324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:08:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:08:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:08:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:29 devstack sudo[97574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:08:29 devstack sudo[97574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:30 devstack sudo[97572]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-778473e6-f8d2-4edb-a188-abb5846d630a tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3" returned: 0 in 0.910s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-778473e6-f8d2-4edb-a188-abb5846d630a tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:30 devstack sudo[97577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.info Jul 09 10:08:30 devstack sudo[97577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:30 devstack sudo[97574]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.259s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:31 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:08:31 devstack sudo[97577]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:31 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:08:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:08:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:08:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-778473e6-f8d2-4edb-a188-abb5846d630a tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.info" returned: 0 in 1.047s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:31 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-778473e6-f8d2-4edb-a188-abb5846d630a tempest-VolumesSnapshotTestJSON-321199851 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.info is being set with open permissions: ugo+rw Jul 09 10:08:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-778473e6-f8d2-4edb-a188-abb5846d630a tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:31 devstack sudo[97581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.info Jul 09 10:08:31 devstack sudo[97581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:31 devstack sudo[97581]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-778473e6-f8d2-4edb-a188-abb5846d630a tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.info" returned: 0 in 0.774s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-778473e6-f8d2-4edb-a188-abb5846d630a tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.201s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-118fbdce-f507-42be-95fd-c8f25108c709 tempest-SnapshotsActionsTest-1159856324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.680s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-118fbdce-f507-42be-95fd-c8f25108c709 tempest-SnapshotsActionsTest-1159856324 None] Creating offline snapshot e3a49788-85ba-478c-ac29-54911137464a of volume 4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:08:32 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4568ddd6-22cd-416a-8610-6c0914d2a439]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-118fbdce-f507-42be-95fd-c8f25108c709 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:32 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-778473e6-f8d2-4edb-a188-abb5846d630a tempest-VolumesSnapshotTestJSON-321199851 None] Create snapshot completed successfully Jul 09 10:08:32 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d Jul 09 10:08:32 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:33 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-118fbdce-f507-42be-95fd-c8f25108c709 tempest-SnapshotsActionsTest-1159856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d" returned: 0 in 1.098s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-118fbdce-f507-42be-95fd-c8f25108c709 tempest-SnapshotsActionsTest-1159856324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:08:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-118fbdce-f507-42be-95fd-c8f25108c709 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.e3a49788-85ba-478c-ac29-54911137464a 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:33 devstack sudo[97592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.e3a49788-85ba-478c-ac29-54911137464a 1G Jul 09 10:08:33 devstack sudo[97592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:33 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:08:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Flow 'volume_create_manager' (c94f5791-e7f3-4801-a8be-9e04c8df8441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:08:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7fae07-f46c-4d7e-ac3c-65a922c2610b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:08:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c7fae07-f46c-4d7e-ac3c-65a922c2610b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:08:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-941349010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=009bd441-49e4-487f-bc97-7090e00a8500,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='881b76c1042a4098baf5421bcbe001bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8931a496-a604-42c2-b3eb-83a218d9c8b3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:08:33Z,use_quota=True,user_id='92298f2eb1c84c37bf70ad8de84230f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:08:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7994b33-6bab-4ec9-83d5-3e17120988a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:08:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7994b33-6bab-4ec9-83d5-3e17120988a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:08:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (368aaba8-14ca-4ef5-bf08-e650b4165efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:08:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (368aaba8-14ca-4ef5-bf08-e650b4165efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '009bd441-49e4-487f-bc97-7090e00a8500', 'volume_name': 'volume-009bd441-49e4-487f-bc97-7090e00a8500', 'volume_size': 1, 'snapshot_id': '8931a496-a604-42c2-b3eb-83a218d9c8b3'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:08:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d4da6e-8672-418d-b9ce-91dba29aad44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:08:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (30d4da6e-8672-418d-b9ce-91dba29aad44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:08:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9e0896-edfb-42e4-9c44-f8a88f8b850a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:08:33 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Volume 009bd441-49e4-487f-bc97-7090e00a8500: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-009bd441-49e4-487f-bc97-7090e00a8500', 'volume_size': 1, 'snapshot_id': '8931a496-a604-42c2-b3eb-83a218d9c8b3'} Jul 09 10:08:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:34 devstack sudo[97592]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-118fbdce-f507-42be-95fd-c8f25108c709 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.e3a49788-85ba-478c-ac29-54911137464a 1G" returned: 0 in 1.251s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-118fbdce-f507-42be-95fd-c8f25108c709 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.e3a49788-85ba-478c-ac29-54911137464a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:34 devstack sudo[97599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.e3a49788-85ba-478c-ac29-54911137464a Jul 09 10:08:34 devstack sudo[97599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:35 devstack sudo[97599]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-118fbdce-f507-42be-95fd-c8f25108c709 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.e3a49788-85ba-478c-ac29-54911137464a" returned: 0 in 0.752s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:35 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-118fbdce-f507-42be-95fd-c8f25108c709 tempest-SnapshotsActionsTest-1159856324 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.e3a49788-85ba-478c-ac29-54911137464a is being set with open permissions: ugo+rw Jul 09 10:08:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-118fbdce-f507-42be-95fd-c8f25108c709 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.e3a49788-85ba-478c-ac29-54911137464a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:35 devstack sudo[97615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.e3a49788-85ba-478c-ac29-54911137464a Jul 09 10:08:35 devstack sudo[97615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:35 devstack sudo[97615]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-118fbdce-f507-42be-95fd-c8f25108c709 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.e3a49788-85ba-478c-ac29-54911137464a" returned: 0 in 0.700s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-118fbdce-f507-42be-95fd-c8f25108c709 tempest-SnapshotsActionsTest-1159856324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.916s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.459s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-quobyte-8931a496-a604-42c2-b3eb-83a218d9c8b3-009bd441-49e4-487f-bc97-7090e00a8500" by "_create_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-8931a496-a604-42c2-b3eb-83a218d9c8b3-009bd441-49e4-487f-bc97-7090e00a8500" acquired by "_create_volume_from_snapshot" :: waited 0.044s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Creating volume 009bd441-49e4-487f-bc97-7090e00a8500 from snapshot 8931a496-a604-42c2-b3eb-83a218d9c8b3 {{(pid=87192) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 10:08:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:08:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:08:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:08:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-quobyte-009bd441-49e4-487f-bc97-7090e00a8500" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:35 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-118fbdce-f507-42be-95fd-c8f25108c709 tempest-SnapshotsActionsTest-1159856324 None] Create snapshot completed successfully Jul 09 10:08:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-009bd441-49e4-487f-bc97-7090e00a8500" acquired by "_copy_volume_from_snapshot" :: waited 0.045s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] snapshot: 8931a496-a604-42c2-b3eb-83a218d9c8b3, volume: 009bd441-49e4-487f-bc97-7090e00a8500, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 10:08:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:08:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:08:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:36 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a4b47c9-faf7-46b0-8c41-afe428621a6a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:36 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3 Jul 09 10:08:36 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] Acquiring lock "cinder-e3a49788-85ba-478c-ac29-54911137464a-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-e3a49788-85ba-478c-ac29-54911137464a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] Acquiring lock "cinder-quobyte-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-quobyte-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] Acquiring lock "cinder-quobyte-e3a49788-85ba-478c-ac29-54911137464a" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-quobyte-e3a49788-85ba-478c-ac29-54911137464a" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] Deleting offline snapshot e3a49788-85ba-478c-ac29-54911137464a of volume 4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:08:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] snapshot_file for this snap is: volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.e3a49788-85ba-478c-ac29-54911137464a {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:08:37 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[55f68798-ee61-4fd3-af1e-25bbc19f2915]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.e3a49788-85ba-478c-ac29-54911137464a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:37 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3" returned: 0 in 1.036s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:08:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 10:08:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 10:08:37 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a23ab2b5-d124-44bf-b38b-f06d0c1ac523]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:37 devstack sudo[97623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.e3a49788-85ba-478c-ac29-54911137464a Jul 09 10:08:37 devstack sudo[97623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:37 devstack sudo[97625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 Jul 09 10:08:37 devstack sudo[97625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:38 devstack sudo[97623]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.e3a49788-85ba-478c-ac29-54911137464a" returned: 0 in 1.253s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:08:38 devstack sudo[97625]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2" returned: 0 in 1.132s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:38 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Path /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-009bd441-49e4-487f-bc97-7090e00a8500 not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 10:08:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-009bd441-49e4-487f-bc97-7090e00a8500 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a9cfabd-8491-4c43-a68c-a234c5fa028b]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:38 devstack sudo[97636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-009bd441-49e4-487f-bc97-7090e00a8500 Jul 09 10:08:38 devstack sudo[97636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:38 devstack sudo[97637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d Jul 09 10:08:38 devstack sudo[97637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:39 devstack sudo[97637]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d" returned: 0 in 1.516s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:08:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.e3a49788-85ba-478c-ac29-54911137464a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:39 devstack sudo[97654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.e3a49788-85ba-478c-ac29-54911137464a Jul 09 10:08:39 devstack sudo[97654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:41 devstack sudo[97654]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.e3a49788-85ba-478c-ac29-54911137464a" returned: 0 in 2.031s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.e3a49788-85ba-478c-ac29-54911137464a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:41 devstack sudo[97690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.e3a49788-85ba-478c-ac29-54911137464a Jul 09 10:08:41 devstack sudo[97690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:43 devstack sudo[97690]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.e3a49788-85ba-478c-ac29-54911137464a" returned: 0 in 1.125s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-quobyte-e3a49788-85ba-478c-ac29-54911137464a" released by "_delete_snapshot" :: held 6.128s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-quobyte-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" released by "delete_snapshot" :: held 6.181s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:43 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] Created reservations ['e215cb07-b845-47ed-9a15-97be7996cd4c', 'dd720cc1-5329-44af-841f-e962e8b68692', '6d499e2a-b631-468a-994a-fba86f07d911', '3b2f9a7d-7b2d-4edc-a258-21b2915b33a7'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:08:43 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] Delete snapshot completed successfully. Jul 09 10:08:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-41fa491a-7015-45d3-b418-1e59dfb23685 tempest-SnapshotsActionsTest-194094311 None] Lock "cinder-e3a49788-85ba-478c-ac29-54911137464a-delete_snapshot" released by "delete_snapshot" :: held 6.654s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:44 devstack sudo[97636]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-009bd441-49e4-487f-bc97-7090e00a8500" returned: 0 in 6.486s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:44 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c7b4c36-70db-4732-a35b-e807709bafa6]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:44 devstack sudo[97694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 Jul 09 10:08:44 devstack sudo[97694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] Acquiring lock "cinder-2d51f088-0840-45e2-a467-7592f717d87d-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] Lock "cinder-2d51f088-0840-45e2-a467-7592f717d87d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] Acquiring lock "cinder-quobyte-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] Lock "cinder-quobyte-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] Acquiring lock "cinder-quobyte-2d51f088-0840-45e2-a467-7592f717d87d" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] Lock "cinder-quobyte-2d51f088-0840-45e2-a467-7592f717d87d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] Deleting offline snapshot 2d51f088-0840-45e2-a467-7592f717d87d of volume 4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:08:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] snapshot_file for this snap is: volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:08:45 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6024befe-a08f-459b-b89e-8dcaeb15f554]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:45 devstack sudo[97696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d Jul 09 10:08:45 devstack sudo[97696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:45 devstack sudo[97694]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2" returned: 0 in 1.057s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:45 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Image conversion details: src /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2, size 1024.00 MB, duration 6.49 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-009bd441-49e4-487f-bc97-7090e00a8500 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:08:45 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Converted 1024.00 MB image at 157.85 MB/s Jul 09 10:08:45 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-009bd441-49e4-487f-bc97-7090e00a8500 is being set with open permissions: ugo+rw Jul 09 10:08:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-009bd441-49e4-487f-bc97-7090e00a8500 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:45 devstack sudo[97703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-009bd441-49e4-487f-bc97-7090e00a8500 Jul 09 10:08:45 devstack sudo[97703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:46 devstack sudo[97696]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d" returned: 0 in 0.812s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:08:46 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9884c42a-66b5-44cd-a556-5d343e457934]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:46 devstack sudo[97706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 Jul 09 10:08:46 devstack sudo[97706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:46 devstack sudo[97703]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-009bd441-49e4-487f-bc97-7090e00a8500" returned: 0 in 0.734s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-009bd441-49e4-487f-bc97-7090e00a8500" released by "_copy_volume_from_snapshot" :: held 10.613s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-8931a496-a604-42c2-b3eb-83a218d9c8b3-009bd441-49e4-487f-bc97-7090e00a8500" released by "_create_volume_from_snapshot" :: held 10.679s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.725s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f9e0896-edfb-42e4-9c44-f8a88f8b850a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-009bd441-49e4-487f-bc97-7090e00a8500', 'volume_size': 1, 'snapshot_id': '8931a496-a604-42c2-b3eb-83a218d9c8b3'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:08:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ea2f00-fdb2-40ef-86e9-3e86fc22de17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:08:46 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Volume volume-009bd441-49e4-487f-bc97-7090e00a8500 (009bd441-49e4-487f-bc97-7090e00a8500): created successfully Jul 09 10:08:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3ea2f00-fdb2-40ef-86e9-3e86fc22de17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:08:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Flow 'volume_create_manager' (c94f5791-e7f3-4801-a8be-9e04c8df8441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:08:46 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d8302c37-b62c-4aaf-b66f-1af889085675 tempest-VolumesSnapshotTestJSON-321199851 None] Created volume successfully. Jul 09 10:08:46 devstack sudo[97706]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" returned: 0 in 0.800s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:46 devstack sudo[97712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d Jul 09 10:08:46 devstack sudo[97712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-927a3bc4-81c5-4290-8576-7db176ae9a88 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-009bd441-49e4-487f-bc97-7090e00a8500-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-927a3bc4-81c5-4290-8576-7db176ae9a88 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-009bd441-49e4-487f-bc97-7090e00a8500-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-927a3bc4-81c5-4290-8576-7db176ae9a88 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-quobyte-009bd441-49e4-487f-bc97-7090e00a8500" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-927a3bc4-81c5-4290-8576-7db176ae9a88 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-009bd441-49e4-487f-bc97-7090e00a8500" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:47 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[11b6b287-fe17-4716-be29-227f1b22c626]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-927a3bc4-81c5-4290-8576-7db176ae9a88 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-009bd441-49e4-487f-bc97-7090e00a8500 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:47 devstack sudo[97714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-009bd441-49e4-487f-bc97-7090e00a8500 Jul 09 10:08:47 devstack sudo[97714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:47 devstack sudo[97712]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d" returned: 0 in 0.838s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:47 devstack sudo[97719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d Jul 09 10:08:47 devstack sudo[97719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:47 devstack sudo[97714]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-927a3bc4-81c5-4290-8576-7db176ae9a88 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-009bd441-49e4-487f-bc97-7090e00a8500" returned: 0 in 0.827s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-927a3bc4-81c5-4290-8576-7db176ae9a88 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-009bd441-49e4-487f-bc97-7090e00a8500 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:47 devstack sudo[97725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-009bd441-49e4-487f-bc97-7090e00a8500 Jul 09 10:08:47 devstack sudo[97725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:48 devstack sudo[97719]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2.2d51f088-0840-45e2-a467-7592f717d87d" returned: 0 in 0.701s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] Lock "cinder-quobyte-2d51f088-0840-45e2-a467-7592f717d87d" released by "_delete_snapshot" :: held 3.290s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] Lock "cinder-quobyte-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" released by "delete_snapshot" :: held 3.317s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:48 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] Created reservations ['909ce6d0-edf1-4473-afa8-cbbca78da961', '129185b8-455f-4ec3-9297-e63721d216d3', '3743e651-674e-49f5-8b4c-8ba1083df3eb', 'dcb8e65a-c0f8-4f54-9b9c-3d90d49079a2'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:08:48 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] Delete snapshot completed successfully. Jul 09 10:08:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-55266ee5-baa3-47e4-b140-72f8bdfa71a5 tempest-SnapshotsActionsTest-1159856324 None] Lock "cinder-2d51f088-0840-45e2-a467-7592f717d87d-delete_snapshot" released by "delete_snapshot" :: held 3.503s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-927a3bc4-81c5-4290-8576-7db176ae9a88 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-009bd441-49e4-487f-bc97-7090e00a8500" returned: 0 in 0.963s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:48 devstack sudo[97725]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-927a3bc4-81c5-4290-8576-7db176ae9a88 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-009bd441-49e4-487f-bc97-7090e00a8500" released by "delete_volume" :: held 1.838s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:48 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-927a3bc4-81c5-4290-8576-7db176ae9a88 tempest-VolumesSnapshotTestJSON-321199851 None] Created reservations ['c897aa36-2248-4b13-bb55-d5dbcb710404', '45990792-d1fa-4e21-acec-f8f1e3d31e38', 'f82fd8b6-d266-46e0-bd06-90b86f7a82a5', '8c2b907d-3d70-459d-883b-21e5055579dd'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:08:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-927a3bc4-81c5-4290-8576-7db176ae9a88 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-927a3bc4-81c5-4290-8576-7db176ae9a88 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-927a3bc4-81c5-4290-8576-7db176ae9a88 tempest-VolumesSnapshotTestJSON-321199851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:08:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-927a3bc4-81c5-4290-8576-7db176ae9a88 tempest-VolumesSnapshotTestJSON-321199851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:08:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-927a3bc4-81c5-4290-8576-7db176ae9a88 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-927a3bc4-81c5-4290-8576-7db176ae9a88 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:49 devstack sudo[97731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:08:49 devstack sudo[97731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-8931a496-a604-42c2-b3eb-83a218d9c8b3-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-8931a496-a604-42c2-b3eb-83a218d9c8b3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-quobyte-f0e46a6d-5bb9-4956-999d-0d041ce887a2" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-f0e46a6d-5bb9-4956-999d-0d041ce887a2" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-quobyte-8931a496-a604-42c2-b3eb-83a218d9c8b3" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-8931a496-a604-42c2-b3eb-83a218d9c8b3" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] Deleting offline snapshot 8931a496-a604-42c2-b3eb-83a218d9c8b3 of volume f0e46a6d-5bb9-4956-999d-0d041ce887a2 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:08:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] snapshot_file for this snap is: volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:08:49 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f8b42bb-cc36-42c5-a336-278950720916]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:49 devstack sudo[97733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3 Jul 09 10:08:49 devstack sudo[97733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0198c6c7-c988-4b03-85df-1ffe1793999c tempest-SnapshotsActionsTest-1159856324 None] Acquiring lock "cinder-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0198c6c7-c988-4b03-85df-1ffe1793999c tempest-SnapshotsActionsTest-1159856324 None] Lock "cinder-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0198c6c7-c988-4b03-85df-1ffe1793999c tempest-SnapshotsActionsTest-1159856324 None] Acquiring lock "cinder-quobyte-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0198c6c7-c988-4b03-85df-1ffe1793999c tempest-SnapshotsActionsTest-1159856324 None] Lock "cinder-quobyte-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:49 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f78bdee-65c1-4eb6-868b-99e674883a26]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0198c6c7-c988-4b03-85df-1ffe1793999c tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:50 devstack sudo[97736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 Jul 09 10:08:50 devstack sudo[97736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:50 devstack sudo[97731]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-927a3bc4-81c5-4290-8576-7db176ae9a88 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.054s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:50 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-927a3bc4-81c5-4290-8576-7db176ae9a88 tempest-VolumesSnapshotTestJSON-321199851 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:08:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-927a3bc4-81c5-4290-8576-7db176ae9a88 tempest-VolumesSnapshotTestJSON-321199851 None] Deleted volume successfully. Jul 09 10:08:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-927a3bc4-81c5-4290-8576-7db176ae9a88 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-009bd441-49e4-487f-bc97-7090e00a8500-delete_volume" released by "delete_volume" :: held 3.164s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:50 devstack sudo[97733]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3" returned: 0 in 1.263s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:08:50 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[73f398b0-81db-4501-b087-ec2505c264da]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:50 devstack sudo[97744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 Jul 09 10:08:50 devstack sudo[97744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:50 devstack sudo[97736]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0198c6c7-c988-4b03-85df-1ffe1793999c tempest-SnapshotsActionsTest-1159856324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" returned: 0 in 1.080s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0198c6c7-c988-4b03-85df-1ffe1793999c tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:50 devstack sudo[97747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2 Jul 09 10:08:50 devstack sudo[97747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:51 devstack sudo[97744]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2" returned: 0 in 0.922s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:51 devstack sudo[97753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3 Jul 09 10:08:51 devstack sudo[97753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:51 devstack sudo[97747]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0198c6c7-c988-4b03-85df-1ffe1793999c tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" returned: 0 in 0.786s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0198c6c7-c988-4b03-85df-1ffe1793999c tempest-SnapshotsActionsTest-1159856324 None] Lock "cinder-quobyte-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2" released by "delete_volume" :: held 1.962s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:51 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-0198c6c7-c988-4b03-85df-1ffe1793999c tempest-SnapshotsActionsTest-1159856324 None] Created reservations ['265bdbf4-ec0d-467a-8d25-a064aeb6e714', 'e08cfdd6-461e-48e0-991e-3c0e0db6f0ce', '8629cad9-b668-4811-9b92-84b99ab14311', '7c9c0ce5-9bb1-4de1-9fc8-1a086cbcc2e1'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:08:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0198c6c7-c988-4b03-85df-1ffe1793999c tempest-SnapshotsActionsTest-1159856324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0198c6c7-c988-4b03-85df-1ffe1793999c tempest-SnapshotsActionsTest-1159856324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0198c6c7-c988-4b03-85df-1ffe1793999c tempest-SnapshotsActionsTest-1159856324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:08:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0198c6c7-c988-4b03-85df-1ffe1793999c tempest-SnapshotsActionsTest-1159856324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:08:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0198c6c7-c988-4b03-85df-1ffe1793999c tempest-SnapshotsActionsTest-1159856324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0198c6c7-c988-4b03-85df-1ffe1793999c tempest-SnapshotsActionsTest-1159856324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:51 devstack sudo[97755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:08:51 devstack sudo[97755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:52 devstack sudo[97753]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3" returned: 0 in 1.157s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:52 devstack sudo[97763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3 Jul 09 10:08:52 devstack sudo[97763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:53 devstack sudo[97755]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0198c6c7-c988-4b03-85df-1ffe1793999c tempest-SnapshotsActionsTest-1159856324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.182s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-0198c6c7-c988-4b03-85df-1ffe1793999c tempest-SnapshotsActionsTest-1159856324 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:08:53 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0198c6c7-c988-4b03-85df-1ffe1793999c tempest-SnapshotsActionsTest-1159856324 None] Deleted volume successfully. Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Flow 'volume_create_manager' (00bcdb20-547b-4508-9ec9-29188f6e0098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (839e27cf-e64d-4691-abb9-c5c61ee25ed6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0198c6c7-c988-4b03-85df-1ffe1793999c tempest-SnapshotsActionsTest-1159856324 None] Lock "cinder-4474ddb2-e40d-48e3-b7a3-055e6e6ba6f2-delete_volume" released by "delete_volume" :: held 3.486s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (839e27cf-e64d-4691-abb9-c5c61ee25ed6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1210603027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f42ef2-e5c4-4165-a75d-4830c8e6dec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec38f289c25142c1a62c63608dcf0cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:08:53Z,use_quota=True,user_id='4e39e88da70a41b497347e00a5c2574c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2418822-1fff-48d5-8496-5230934ce6b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2418822-1fff-48d5-8496-5230934ce6b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8470afa7-fbb2-4a28-8b40-9761b0ea852c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8470afa7-fbb2-4a28-8b40-9761b0ea852c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8f42ef2-e5c4-4165-a75d-4830c8e6dec8', 'volume_name': 'volume-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (299b87c9-b2b1-4525-b354-75755c3202a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (299b87c9-b2b1-4525-b354-75755c3202a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c33331c-b1ef-48ff-a1d6-4109523a7de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:08:53 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Volume b8f42ef2-e5c4-4165-a75d-4830c8e6dec8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8', 'volume_size': 1} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:08:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1210603027',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8f42ef2-e5c4-4165-a75d-4830c8e6dec8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec38f289c25142c1a62c63608dcf0cc7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:08:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:08:53Z,use_quota=True,user_id='4e39e88da70a41b497347e00a5c2574c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Creating volume b8f42ef2-e5c4-4165-a75d-4830c8e6dec8 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:08:53 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:53 devstack sudo[97766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8 1073741824 Jul 09 10:08:53 devstack sudo[97766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:53 devstack sudo[97763]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2.8931a496-a604-42c2-b3eb-83a218d9c8b3" returned: 0 in 1.060s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-8931a496-a604-42c2-b3eb-83a218d9c8b3" released by "_delete_snapshot" :: held 4.591s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-f0e46a6d-5bb9-4956-999d-0d041ce887a2" released by "delete_snapshot" :: held 4.633s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:54 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] Created reservations ['29cbae2e-0b8d-4252-ab45-88b6fdef124f', '6700504a-fbe8-4544-b873-c73bdf4a1eea', '3e438e37-e7ca-457f-8497-103fc2344984', 'd89eafc9-0ad9-4c90-b230-549812735cbd'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:08:54 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] Delete snapshot completed successfully. Jul 09 10:08:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89c1e475-ce70-4298-98e9-ea164171f2bc tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-8931a496-a604-42c2-b3eb-83a218d9c8b3-delete_snapshot" released by "delete_snapshot" :: held 4.866s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:54 devstack sudo[97766]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8 1073741824" returned: 0 in 1.221s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:54 devstack sudo[97773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8 Jul 09 10:08:54 devstack sudo[97773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0d1a2f5c-fed1-48f1-b1a7-a036e804d280 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-f0e46a6d-5bb9-4956-999d-0d041ce887a2-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0d1a2f5c-fed1-48f1-b1a7-a036e804d280 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-f0e46a6d-5bb9-4956-999d-0d041ce887a2-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0d1a2f5c-fed1-48f1-b1a7-a036e804d280 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-quobyte-f0e46a6d-5bb9-4956-999d-0d041ce887a2" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0d1a2f5c-fed1-48f1-b1a7-a036e804d280 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-f0e46a6d-5bb9-4956-999d-0d041ce887a2" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:54 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf415239-4e94-4449-8acc-be2ed421d0e3]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0d1a2f5c-fed1-48f1-b1a7-a036e804d280 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:55 devstack sudo[97775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 Jul 09 10:08:55 devstack sudo[97775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:55 devstack sudo[97773]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8" returned: 0 in 0.906s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] <== create_volume: return (2185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:08:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.188s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c33331c-b1ef-48ff-a1d6-4109523a7de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:08:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48ba001-2f79-417e-9ede-5ad6e68e6c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:08:55 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Volume volume-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8 (b8f42ef2-e5c4-4165-a75d-4830c8e6dec8): created successfully Jul 09 10:08:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f48ba001-2f79-417e-9ede-5ad6e68e6c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:08:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Flow 'volume_create_manager' (00bcdb20-547b-4508-9ec9-29188f6e0098) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:08:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-71fff349-074e-4705-b94a-08839f889d47 tempest-AttachVolumeNegativeTest-2008901733 None] Created volume successfully. Jul 09 10:08:56 devstack sudo[97775]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0d1a2f5c-fed1-48f1-b1a7-a036e804d280 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2" returned: 0 in 1.062s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0d1a2f5c-fed1-48f1-b1a7-a036e804d280 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:56 devstack sudo[97781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2 Jul 09 10:08:56 devstack sudo[97781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:56 devstack sudo[97781]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0d1a2f5c-fed1-48f1-b1a7-a036e804d280 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0e46a6d-5bb9-4956-999d-0d041ce887a2" returned: 0 in 0.745s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0d1a2f5c-fed1-48f1-b1a7-a036e804d280 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-f0e46a6d-5bb9-4956-999d-0d041ce887a2" released by "delete_volume" :: held 1.906s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:56 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-0d1a2f5c-fed1-48f1-b1a7-a036e804d280 tempest-VolumesSnapshotTestJSON-321199851 None] Created reservations ['0c7d9666-0394-4975-9a87-b694d60fbc08', '67c2460f-fb35-4c04-a6c4-1467e7602e63', '7f3a44da-6a95-46d5-8873-f1056fdc99a0', '81fe9296-991b-4cbf-9795-92aa83be4973'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:08:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0d1a2f5c-fed1-48f1-b1a7-a036e804d280 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0d1a2f5c-fed1-48f1-b1a7-a036e804d280 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0d1a2f5c-fed1-48f1-b1a7-a036e804d280 tempest-VolumesSnapshotTestJSON-321199851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:08:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0d1a2f5c-fed1-48f1-b1a7-a036e804d280 tempest-VolumesSnapshotTestJSON-321199851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:08:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0d1a2f5c-fed1-48f1-b1a7-a036e804d280 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0d1a2f5c-fed1-48f1-b1a7-a036e804d280 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:56 devstack sudo[97787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:08:56 devstack sudo[97787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dc454295-d794-408e-9c26-b25f09251380 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dc454295-d794-408e-9c26-b25f09251380 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dc454295-d794-408e-9c26-b25f09251380 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "cinder-quobyte-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:08:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dc454295-d794-408e-9c26-b25f09251380 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:08:57 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[37a91156-1a31-488d-88ff-c141d9b6d46c]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc454295-d794-408e-9c26-b25f09251380 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:57 devstack sudo[97789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a Jul 09 10:08:57 devstack sudo[97789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:57 devstack sudo[97787]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0d1a2f5c-fed1-48f1-b1a7-a036e804d280 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.768s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:57 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-0d1a2f5c-fed1-48f1-b1a7-a036e804d280 tempest-VolumesSnapshotTestJSON-321199851 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:08:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0d1a2f5c-fed1-48f1-b1a7-a036e804d280 tempest-VolumesSnapshotTestJSON-321199851 None] Deleted volume successfully. Jul 09 10:08:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0d1a2f5c-fed1-48f1-b1a7-a036e804d280 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-f0e46a6d-5bb9-4956-999d-0d041ce887a2-delete_volume" released by "delete_volume" :: held 2.924s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:58 devstack sudo[97789]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc454295-d794-408e-9c26-b25f09251380 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a" returned: 0 in 0.882s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc454295-d794-408e-9c26-b25f09251380 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:58 devstack sudo[97796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a Jul 09 10:08:58 devstack sudo[97796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:59 devstack sudo[97796]: pam_unix(sudo:session): session closed for user root Jul 09 10:08:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc454295-d794-408e-9c26-b25f09251380 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a" returned: 0 in 0.737s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:08:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dc454295-d794-408e-9c26-b25f09251380 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-quobyte-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a" released by "delete_volume" :: held 1.696s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:08:59 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-dc454295-d794-408e-9c26-b25f09251380 tempest-VolumesSnapshotTestJSON-321199851 None] Created reservations ['37fb63ed-741c-4c78-bcef-a10f1e010fab', '64fb6e2f-ea06-4978-8d36-707ba7146e02', 'ef9fd6f6-1e28-46bb-aeb1-b005ea791c68', 'f2b940f3-7e00-4dda-b680-01ae0c9ee158'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:08:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dc454295-d794-408e-9c26-b25f09251380 tempest-VolumesSnapshotTestJSON-321199851 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dc454295-d794-408e-9c26-b25f09251380 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dc454295-d794-408e-9c26-b25f09251380 tempest-VolumesSnapshotTestJSON-321199851 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:08:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dc454295-d794-408e-9c26-b25f09251380 tempest-VolumesSnapshotTestJSON-321199851 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:08:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dc454295-d794-408e-9c26-b25f09251380 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:08:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc454295-d794-408e-9c26-b25f09251380 tempest-VolumesSnapshotTestJSON-321199851 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:59 devstack sudo[97800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:08:59 devstack sudo[97800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:08:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-13646ca5-6ffe-4752-82a8-a748beec724f req-7415273f-bef2-4a16-8126-f00c58b0bbb3 tempest-AttachVolumeNegativeTest-2008901733 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:08:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-13646ca5-6ffe-4752-82a8-a748beec724f req-7415273f-bef2-4a16-8126-f00c58b0bbb3 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:08:59 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[711f0311-1854-48fa-9c12-de3ad36bdfec]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:08:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-13646ca5-6ffe-4752-82a8-a748beec724f req-7415273f-bef2-4a16-8126-f00c58b0bbb3 tempest-AttachVolumeNegativeTest-2008901733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:08:59 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8 Jul 09 10:08:59 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:00 devstack sudo[97800]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc454295-d794-408e-9c26-b25f09251380 tempest-VolumesSnapshotTestJSON-321199851 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.001s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:00 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-dc454295-d794-408e-9c26-b25f09251380 tempest-VolumesSnapshotTestJSON-321199851 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:09:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-dc454295-d794-408e-9c26-b25f09251380 tempest-VolumesSnapshotTestJSON-321199851 None] Deleted volume successfully. Jul 09 10:09:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dc454295-d794-408e-9c26-b25f09251380 tempest-VolumesSnapshotTestJSON-321199851 None] Lock "cinder-9e1e2f8c-9f05-4ff0-8951-eabd1d46993a-delete_volume" released by "delete_volume" :: held 2.972s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:09:00 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-13646ca5-6ffe-4752-82a8-a748beec724f req-7415273f-bef2-4a16-8126-f00c58b0bbb3 tempest-AttachVolumeNegativeTest-2008901733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8" returned: 0 in 1.154s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-13646ca5-6ffe-4752-82a8-a748beec724f req-7415273f-bef2-4a16-8126-f00c58b0bbb3 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.173s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-13646ca5-6ffe-4752-82a8-a748beec724f req-7415273f-bef2-4a16-8126-f00c58b0bbb3 tempest-AttachVolumeNegativeTest-2008901733 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ecedfddd-81f9-4437-ba0f-a36faf79b3bf', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:09:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-13646ca5-6ffe-4752-82a8-a748beec724f req-7415273f-bef2-4a16-8126-f00c58b0bbb3 tempest-AttachVolumeNegativeTest-2008901733 None] attachment_update completed successfully. Jul 09 10:09:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-d9746460-5dde-461c-8598-4810b79e5484 req-8b677b85-9b5f-4fb0-bcd9-847457044518 tempest-AttachVolumeNegativeTest-2008901733 None] Terminate volume connection completed successfully. Jul 09 10:09:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-d9746460-5dde-461c-8598-4810b79e5484 req-8b677b85-9b5f-4fb0-bcd9-847457044518 tempest-AttachVolumeNegativeTest-2008901733 None] Deleting attachment ecedfddd-81f9-4437-ba0f-a36faf79b3bf. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Flow 'volume_create_manager' (8407b3e4-f2b0-42c5-b2c2-81429160593e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9601f3b-307f-4489-87eb-a6ce57c417bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9601f3b-307f-4489-87eb-a6ce57c417bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2070902711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27c58790-b2b1-481e-953f-123890292b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1786fffe3043f496abdb316d7a5066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:09:08Z,use_quota=True,user_id='3d0e3451336d409b95eebd63e35164d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c0b852-18a1-417e-a6b5-d5c4d0a11018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c0b852-18a1-417e-a6b5-d5c4d0a11018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0883cd78-b962-4bf7-8e63-ddbddf3d83b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0883cd78-b962-4bf7-8e63-ddbddf3d83b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27c58790-b2b1-481e-953f-123890292b5c', 'volume_name': 'volume-27c58790-b2b1-481e-953f-123890292b5c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2c7fae-f0ff-4f6a-9724-26565e14001e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2c7fae-f0ff-4f6a-9724-26565e14001e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69290e9-cfba-4937-9be1-b0b48aad4acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Volume 27c58790-b2b1-481e-953f-123890292b5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27c58790-b2b1-481e-953f-123890292b5c', 'volume_size': 1} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-2070902711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27c58790-b2b1-481e-953f-123890292b5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1786fffe3043f496abdb316d7a5066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:09:08Z,use_quota=True,user_id='3d0e3451336d409b95eebd63e35164d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Creating volume 27c58790-b2b1-481e-953f-123890292b5c {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:09:08 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27c58790-b2b1-481e-953f-123890292b5c 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:08 devstack sudo[98231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27c58790-b2b1-481e-953f-123890292b5c 1073741824 Jul 09 10:09:08 devstack sudo[98231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Flow 'volume_create_manager' (baa52437-d40a-4796-9a79-e885265f6a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e39952-b8c2-4b56-968b-f14a7b9aa184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e39952-b8c2-4b56-968b-f14a7b9aa184) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-534585259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b69108-98eb-4162-b53b-9de5bb423074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1786fffe3043f496abdb316d7a5066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:09:08Z,use_quota=True,user_id='3d0e3451336d409b95eebd63e35164d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d45f58f-88a2-434e-819d-20c7b4414eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d45f58f-88a2-434e-819d-20c7b4414eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb31507-2d8e-4afb-8ba5-501d14e636d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddb31507-2d8e-4afb-8ba5-501d14e636d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84b69108-98eb-4162-b53b-9de5bb423074', 'volume_name': 'volume-84b69108-98eb-4162-b53b-9de5bb423074', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1935d2-66cb-48b2-bb28-ed7f85f61dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df1935d2-66cb-48b2-bb28-ed7f85f61dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4bf7a83-e9db-4e28-98d8-380f57fcb20b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Volume 84b69108-98eb-4162-b53b-9de5bb423074: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84b69108-98eb-4162-b53b-9de5bb423074', 'volume_size': 1} Jul 09 10:09:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:09 devstack sudo[98231]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27c58790-b2b1-481e-953f-123890292b5c 1073741824" returned: 0 in 1.271s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27c58790-b2b1-481e-953f-123890292b5c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:09 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:09:09 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27c58790-b2b1-481e-953f-123890292b5c Jul 09 10:09:09 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Flow 'volume_create_manager' (c88458ee-f0e1-41a8-95d3-eee584e01c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:09:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c417a009-8b08-4ffc-b3de-b82d17f15eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c417a009-8b08-4ffc-b3de-b82d17f15eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1785805491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c77abcf-b0c7-441a-a6b0-ab73275ba883,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ef98e48dcd4f72a35db3d182f5d178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:09:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:09:10Z,use_quota=True,user_id='2ddfb4fdc1034a68b4de6ea9caaeabdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b72a841-9817-4a7f-8283-1f5ddcd8ae6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b72a841-9817-4a7f-8283-1f5ddcd8ae6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f75741-279a-4773-b15c-c070d979667e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8f75741-279a-4773-b15c-c070d979667e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c77abcf-b0c7-441a-a6b0-ab73275ba883', 'volume_name': 'volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883', 'volume_size': 2}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5567a50-a859-4e36-8fe8-8a2301f7b111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5567a50-a859-4e36-8fe8-8a2301f7b111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb06bda-145f-421c-9242-24aaf74e129d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:09 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Volume 0c77abcf-b0c7-441a-a6b0-ab73275ba883: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883', 'volume_size': 2} Jul 09 10:09:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:10 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27c58790-b2b1-481e-953f-123890292b5c" returned: 0 in 0.771s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] <== create_volume: return (2114ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:09:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.117s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.691s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:09:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-534585259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84b69108-98eb-4162-b53b-9de5bb423074,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9e1786fffe3043f496abdb316d7a5066',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:09:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:09:08Z,use_quota=True,user_id='3d0e3451336d409b95eebd63e35164d6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:09:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Creating volume 84b69108-98eb-4162-b53b-9de5bb423074 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:09:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:09:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:09:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:09:10 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:09:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-84b69108-98eb-4162-b53b-9de5bb423074 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e69290e9-cfba-4937-9be1-b0b48aad4acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27c58790-b2b1-481e-953f-123890292b5c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:10 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-84b69108-98eb-4162-b53b-9de5bb423074 1073741824 Jul 09 10:09:10 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7877afef-85fc-46c9-8a54-11f29c877d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:10 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Volume volume-27c58790-b2b1-481e-953f-123890292b5c (27c58790-b2b1-481e-953f-123890292b5c): created successfully Jul 09 10:09:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7877afef-85fc-46c9-8a54-11f29c877d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Flow 'volume_create_manager' (8407b3e4-f2b0-42c5-b2c2-81429160593e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:09:10 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-06eed30f-107a-46dc-97ea-2ed9309da78d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Created volume successfully. Jul 09 10:09:11 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-84b69108-98eb-4162-b53b-9de5bb423074 1073741824" returned: 0 in 1.066s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:11 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:09:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Flow 'volume_create_manager' (cf60c25a-99a4-40c9-8985-871c6692eb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:09:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e2915f-72a9-4904-9445-47b25bfa0181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3e2915f-72a9-4904-9445-47b25bfa0181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1819301991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c11157f-278d-436a-9ee9-fb10e99e8205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206182dff65b4d44a62a773c41d687fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:09:11Z,use_quota=True,user_id='eb7e8ec5e2f94ae3a0972244822fa81d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b09eb73-b6a4-4723-bf18-7453a7226d92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b09eb73-b6a4-4723-bf18-7453a7226d92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b06e83-bc3e-4d20-98e6-ca8868308e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89b06e83-bc3e-4d20-98e6-ca8868308e17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c11157f-278d-436a-9ee9-fb10e99e8205', 'volume_name': 'volume-0c11157f-278d-436a-9ee9-fb10e99e8205', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (062fefe4-65f6-4c4e-9513-95ac34c4aa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (062fefe4-65f6-4c4e-9513-95ac34c4aa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010123f9-2b9b-47fe-ae76-d7aec9e650db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:11 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Volume 0c11157f-278d-436a-9ee9-fb10e99e8205: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c11157f-278d-436a-9ee9-fb10e99e8205', 'volume_size': 1} Jul 09 10:09:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-84b69108-98eb-4162-b53b-9de5bb423074 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:11 devstack sudo[98253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-84b69108-98eb-4162-b53b-9de5bb423074 Jul 09 10:09:11 devstack sudo[98253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:12 devstack sudo[98253]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-84b69108-98eb-4162-b53b-9de5bb423074" returned: 0 in 1.006s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] <== create_volume: return (2210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:09:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.213s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.783s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:09:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1785805491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c77abcf-b0c7-441a-a6b0-ab73275ba883,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d8ef98e48dcd4f72a35db3d182f5d178',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:09:09Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:09:10Z,use_quota=True,user_id='2ddfb4fdc1034a68b4de6ea9caaeabdc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:09:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Creating volume 0c77abcf-b0c7-441a-a6b0-ab73275ba883 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:09:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:09:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:09:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:09:12 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:09:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883 2147483648 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:12 devstack sudo[98276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883 2147483648 Jul 09 10:09:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c4bf7a83-e9db-4e28-98d8-380f57fcb20b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84b69108-98eb-4162-b53b-9de5bb423074', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:12 devstack sudo[98276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (059bedea-5244-4839-be74-a613c75cd1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:12 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Volume volume-84b69108-98eb-4162-b53b-9de5bb423074 (84b69108-98eb-4162-b53b-9de5bb423074): created successfully Jul 09 10:09:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (059bedea-5244-4839-be74-a613c75cd1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Flow 'volume_create_manager' (baa52437-d40a-4796-9a79-e885265f6a62) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:09:12 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f96a48ad-c095-446d-b63c-228dd4721a77 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Created volume successfully. Jul 09 10:09:13 devstack sudo[98276]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883 2147483648" returned: 0 in 1.103s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:13 devstack sudo[98284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883 Jul 09 10:09:13 devstack sudo[98284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:14 devstack sudo[98284]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883" returned: 0 in 0.671s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] <== create_volume: return (1826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:09:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.829s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.851s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:09:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1819301991',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c11157f-278d-436a-9ee9-fb10e99e8205,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206182dff65b4d44a62a773c41d687fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:09:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:09:11Z,use_quota=True,user_id='eb7e8ec5e2f94ae3a0972244822fa81d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:09:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Creating volume 0c11157f-278d-436a-9ee9-fb10e99e8205 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:09:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:09:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:09:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:09:14 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:09:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c11157f-278d-436a-9ee9-fb10e99e8205 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4fb06bda-145f-421c-9242-24aaf74e129d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883', 'volume_size': 2}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:14 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c11157f-278d-436a-9ee9-fb10e99e8205 1073741824 Jul 09 10:09:14 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d7c214-3273-4ea1-b332-6066a5a96e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:14 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Volume volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883 (0c77abcf-b0c7-441a-a6b0-ab73275ba883): created successfully Jul 09 10:09:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30d7c214-3273-4ea1-b332-6066a5a96e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Flow 'volume_create_manager' (c88458ee-f0e1-41a8-95d3-eee584e01c52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:09:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a201143d-b96f-4bfa-a692-6b2539322b3a tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Created volume successfully. Jul 09 10:09:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9f03ec51-f2cb-42b0-8725-442668af4fe3 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:15 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c11157f-278d-436a-9ee9-fb10e99e8205 1073741824" returned: 0 in 0.905s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c11157f-278d-436a-9ee9-fb10e99e8205 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:15 devstack sudo[98293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c11157f-278d-436a-9ee9-fb10e99e8205 Jul 09 10:09:15 devstack sudo[98293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:15 devstack sudo[98293]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c11157f-278d-436a-9ee9-fb10e99e8205" returned: 0 in 0.645s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:09:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.589s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9f03ec51-f2cb-42b0-8725-442668af4fe3 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.937s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (010123f9-2b9b-47fe-ae76-d7aec9e650db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c11157f-278d-436a-9ee9-fb10e99e8205', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03d356a-fae6-4d37-bbc4-106486ab1651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9f03ec51-f2cb-42b0-8725-442668af4fe3 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Creating offline snapshot d3f9b629-4efa-4cf8-8942-a02a0575f199 of volume 0c77abcf-b0c7-441a-a6b0-ab73275ba883 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:09:16 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Volume volume-0c11157f-278d-436a-9ee9-fb10e99e8205 (0c11157f-278d-436a-9ee9-fb10e99e8205): created successfully Jul 09 10:09:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03d356a-fae6-4d37-bbc4-106486ab1651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Flow 'volume_create_manager' (cf60c25a-99a4-40c9-8985-871c6692eb14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:09:16 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[95e103a9-6312-4795-ba46-d5f933ae1655]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:09:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f03ec51-f2cb-42b0-8725-442668af4fe3 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:16 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ada9d4bd-ca1d-4e79-849a-25f7c3f21fd7 tempest-VolumeQuotasAdminTestJSON-359806090 None] Created volume successfully. Jul 09 10:09:16 devstack sudo[98296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883 Jul 09 10:09:16 devstack sudo[98296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:16 devstack sudo[98296]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f03ec51-f2cb-42b0-8725-442668af4fe3 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883" returned: 0 in 0.806s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f03ec51-f2cb-42b0-8725-442668af4fe3 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.d3f9b629-4efa-4cf8-8942-a02a0575f199 2G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fdc38c34-0a0e-4d88-b12c-190b009051ba tempest-VolumeQuotasAdminTestJSON-359806090 None] Acquiring lock "cinder-0c11157f-278d-436a-9ee9-fb10e99e8205-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:09:16 devstack sudo[98301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.d3f9b629-4efa-4cf8-8942-a02a0575f199 2G Jul 09 10:09:16 devstack sudo[98301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fdc38c34-0a0e-4d88-b12c-190b009051ba tempest-VolumeQuotasAdminTestJSON-359806090 None] Lock "cinder-0c11157f-278d-436a-9ee9-fb10e99e8205-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:09:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fdc38c34-0a0e-4d88-b12c-190b009051ba tempest-VolumeQuotasAdminTestJSON-359806090 None] Acquiring lock "cinder-quobyte-0c11157f-278d-436a-9ee9-fb10e99e8205" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:09:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fdc38c34-0a0e-4d88-b12c-190b009051ba tempest-VolumeQuotasAdminTestJSON-359806090 None] Lock "cinder-quobyte-0c11157f-278d-436a-9ee9-fb10e99e8205" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:09:16 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1af581aa-1303-4300-8793-e4bd8f70ad8b]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:09:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fdc38c34-0a0e-4d88-b12c-190b009051ba tempest-VolumeQuotasAdminTestJSON-359806090 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c11157f-278d-436a-9ee9-fb10e99e8205 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:17 devstack sudo[98303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c11157f-278d-436a-9ee9-fb10e99e8205 Jul 09 10:09:17 devstack sudo[98303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:17 devstack sudo[98301]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f03ec51-f2cb-42b0-8725-442668af4fe3 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.d3f9b629-4efa-4cf8-8942-a02a0575f199 2G" returned: 0 in 0.929s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f03ec51-f2cb-42b0-8725-442668af4fe3 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.d3f9b629-4efa-4cf8-8942-a02a0575f199 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:17 devstack sudo[98315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.d3f9b629-4efa-4cf8-8942-a02a0575f199 Jul 09 10:09:17 devstack sudo[98315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:17 devstack sudo[98303]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fdc38c34-0a0e-4d88-b12c-190b009051ba tempest-VolumeQuotasAdminTestJSON-359806090 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c11157f-278d-436a-9ee9-fb10e99e8205" returned: 0 in 0.907s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fdc38c34-0a0e-4d88-b12c-190b009051ba tempest-VolumeQuotasAdminTestJSON-359806090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c11157f-278d-436a-9ee9-fb10e99e8205 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:17 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c11157f-278d-436a-9ee9-fb10e99e8205 Jul 09 10:09:17 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:18 devstack sudo[98315]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f03ec51-f2cb-42b0-8725-442668af4fe3 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.d3f9b629-4efa-4cf8-8942-a02a0575f199" returned: 0 in 0.799s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:18 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-9f03ec51-f2cb-42b0-8725-442668af4fe3 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.d3f9b629-4efa-4cf8-8942-a02a0575f199 is being set with open permissions: ugo+rw Jul 09 10:09:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f03ec51-f2cb-42b0-8725-442668af4fe3 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.d3f9b629-4efa-4cf8-8942-a02a0575f199 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:18 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fdc38c34-0a0e-4d88-b12c-190b009051ba tempest-VolumeQuotasAdminTestJSON-359806090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c11157f-278d-436a-9ee9-fb10e99e8205" returned: 0 in 0.733s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:18 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.d3f9b629-4efa-4cf8-8942-a02a0575f199 Jul 09 10:09:18 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fdc38c34-0a0e-4d88-b12c-190b009051ba tempest-VolumeQuotasAdminTestJSON-359806090 None] Lock "cinder-quobyte-0c11157f-278d-436a-9ee9-fb10e99e8205" released by "delete_volume" :: held 1.701s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:09:18 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-fdc38c34-0a0e-4d88-b12c-190b009051ba tempest-VolumeQuotasAdminTestJSON-359806090 None] Created reservations ['564f976b-900c-469a-bdf2-8e06ebaa488e', '356c32b5-740f-4570-b9e5-b8e4354052de', '54edb182-c19b-4789-b48a-1b4e396693e6', '30b1b19f-6da8-40e9-9201-6b875b2b425d'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:09:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fdc38c34-0a0e-4d88-b12c-190b009051ba tempest-VolumeQuotasAdminTestJSON-359806090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fdc38c34-0a0e-4d88-b12c-190b009051ba tempest-VolumeQuotasAdminTestJSON-359806090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fdc38c34-0a0e-4d88-b12c-190b009051ba tempest-VolumeQuotasAdminTestJSON-359806090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:09:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fdc38c34-0a0e-4d88-b12c-190b009051ba tempest-VolumeQuotasAdminTestJSON-359806090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:09:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fdc38c34-0a0e-4d88-b12c-190b009051ba tempest-VolumeQuotasAdminTestJSON-359806090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fdc38c34-0a0e-4d88-b12c-190b009051ba tempest-VolumeQuotasAdminTestJSON-359806090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:18 devstack sudo[98325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:09:18 devstack sudo[98325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:19 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f03ec51-f2cb-42b0-8725-442668af4fe3 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.d3f9b629-4efa-4cf8-8942-a02a0575f199" returned: 0 in 1.369s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f03ec51-f2cb-42b0-8725-442668af4fe3 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:20 devstack sudo[98341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.info Jul 09 10:09:20 devstack sudo[98341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:20 devstack sudo[98325]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fdc38c34-0a0e-4d88-b12c-190b009051ba tempest-VolumeQuotasAdminTestJSON-359806090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.356s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-fdc38c34-0a0e-4d88-b12c-190b009051ba tempest-VolumeQuotasAdminTestJSON-359806090 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:09:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-fdc38c34-0a0e-4d88-b12c-190b009051ba tempest-VolumeQuotasAdminTestJSON-359806090 None] Deleted volume successfully. Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-fdc38c34-0a0e-4d88-b12c-190b009051ba tempest-VolumeQuotasAdminTestJSON-359806090 None] Lock "cinder-0c11157f-278d-436a-9ee9-fb10e99e8205-delete_volume" released by "delete_volume" :: held 3.400s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Flow 'volume_create_manager' (25eef30e-5533-457e-827d-a6c5392bad4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3342377-582b-499b-b643-34bc506bca45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3342377-582b-499b-b643-34bc506bca45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1018252318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=788b48a1-5c06-4c50-92c7-8f731a421201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206182dff65b4d44a62a773c41d687fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:09:20Z,use_quota=True,user_id='eb7e8ec5e2f94ae3a0972244822fa81d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3cf69c-47d7-4c03-a5dd-82a205cb7dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd3cf69c-47d7-4c03-a5dd-82a205cb7dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd93719-643e-43ed-9570-edf4c82cae90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3dd93719-643e-43ed-9570-edf4c82cae90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '788b48a1-5c06-4c50-92c7-8f731a421201', 'volume_name': 'volume-788b48a1-5c06-4c50-92c7-8f731a421201', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ed572a-bad1-43e0-a37f-ae7238eb52cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b7ed572a-bad1-43e0-a37f-ae7238eb52cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6139861f-816a-4f44-8afe-e2e113c08c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:20 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Volume 788b48a1-5c06-4c50-92c7-8f731a421201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-788b48a1-5c06-4c50-92c7-8f731a421201', 'volume_size': 1} Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1dc30732-b349-4e62-aad2-7f9ff5cca028 tempest-AttachVolumeNegativeTest-2008901733 None] Acquiring lock "cinder-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1dc30732-b349-4e62-aad2-7f9ff5cca028 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "cinder-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1dc30732-b349-4e62-aad2-7f9ff5cca028 tempest-AttachVolumeNegativeTest-2008901733 None] Acquiring lock "cinder-quobyte-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1dc30732-b349-4e62-aad2-7f9ff5cca028 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "cinder-quobyte-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4574786-f8e4-40e3-a3a7-b0c544d896ac]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dc30732-b349-4e62-aad2-7f9ff5cca028 tempest-AttachVolumeNegativeTest-2008901733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:20 devstack sudo[98349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8 Jul 09 10:09:20 devstack sudo[98349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:20 devstack sudo[98341]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f03ec51-f2cb-42b0-8725-442668af4fe3 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.info" returned: 0 in 0.976s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:20 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-9f03ec51-f2cb-42b0-8725-442668af4fe3 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.info is being set with open permissions: ugo+rw Jul 09 10:09:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f03ec51-f2cb-42b0-8725-442668af4fe3 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:21 devstack sudo[98352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.info Jul 09 10:09:21 devstack sudo[98352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:21 devstack sudo[98349]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dc30732-b349-4e62-aad2-7f9ff5cca028 tempest-AttachVolumeNegativeTest-2008901733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8" returned: 0 in 0.851s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dc30732-b349-4e62-aad2-7f9ff5cca028 tempest-AttachVolumeNegativeTest-2008901733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:21 devstack sudo[98358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8 Jul 09 10:09:21 devstack sudo[98358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:21 devstack sudo[98352]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f03ec51-f2cb-42b0-8725-442668af4fe3 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.info" returned: 0 in 0.712s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9f03ec51-f2cb-42b0-8725-442668af4fe3 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.750s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.324s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:09:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1018252318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=788b48a1-5c06-4c50-92c7-8f731a421201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='206182dff65b4d44a62a773c41d687fa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:09:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:09:20Z,use_quota=True,user_id='eb7e8ec5e2f94ae3a0972244822fa81d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:09:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Creating volume 788b48a1-5c06-4c50-92c7-8f731a421201 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:09:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:09:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:09:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:09:21 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:09:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-788b48a1-5c06-4c50-92c7-8f731a421201 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:21 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=112,cinder:SELECT=87,cinder:DELETE=8,cinder:INSERT=21 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:09:21 devstack sudo[98361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-788b48a1-5c06-4c50-92c7-8f731a421201 1073741824 Jul 09 10:09:21 devstack sudo[98361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:21 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=87,cinder:INSERT=31,cinder:UPDATE=97,cinder:DELETE=9 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:09:21 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9f03ec51-f2cb-42b0-8725-442668af4fe3 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Create snapshot completed successfully Jul 09 10:09:22 devstack sudo[98358]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dc30732-b349-4e62-aad2-7f9ff5cca028 tempest-AttachVolumeNegativeTest-2008901733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8" returned: 0 in 0.690s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1dc30732-b349-4e62-aad2-7f9ff5cca028 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "cinder-quobyte-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8" released by "delete_volume" :: held 1.597s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-1dc30732-b349-4e62-aad2-7f9ff5cca028 tempest-AttachVolumeNegativeTest-2008901733 None] Created reservations ['f2f36f41-2441-4882-a5e3-974aa6a68955', '8219822f-8299-4a9e-a708-a18136d8757f', '94727fd9-d6c0-4bd1-ae58-8fe43c45c362', '2740b7be-fc1a-49e2-98c4-e5db3021bbb5'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1dc30732-b349-4e62-aad2-7f9ff5cca028 tempest-AttachVolumeNegativeTest-2008901733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1dc30732-b349-4e62-aad2-7f9ff5cca028 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1dc30732-b349-4e62-aad2-7f9ff5cca028 tempest-AttachVolumeNegativeTest-2008901733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1dc30732-b349-4e62-aad2-7f9ff5cca028 tempest-AttachVolumeNegativeTest-2008901733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1dc30732-b349-4e62-aad2-7f9ff5cca028 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dc30732-b349-4e62-aad2-7f9ff5cca028 tempest-AttachVolumeNegativeTest-2008901733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:22 devstack sudo[98364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:09:22 devstack sudo[98364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Acquiring lock "cinder-d3f9b629-4efa-4cf8-8942-a02a0575f199-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Lock "cinder-d3f9b629-4efa-4cf8-8942-a02a0575f199-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Acquiring lock "cinder-quobyte-0c77abcf-b0c7-441a-a6b0-ab73275ba883" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Lock "cinder-quobyte-0c77abcf-b0c7-441a-a6b0-ab73275ba883" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Acquiring lock "cinder-quobyte-d3f9b629-4efa-4cf8-8942-a02a0575f199" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Lock "cinder-quobyte-d3f9b629-4efa-4cf8-8942-a02a0575f199" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Deleting offline snapshot d3f9b629-4efa-4cf8-8942-a02a0575f199 of volume 0c77abcf-b0c7-441a-a6b0-ab73275ba883 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] snapshot_file for this snap is: volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.d3f9b629-4efa-4cf8-8942-a02a0575f199 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[92925f33-ebfc-4c89-8622-c093c1410784]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.d3f9b629-4efa-4cf8-8942-a02a0575f199 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:22 devstack sudo[98361]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-788b48a1-5c06-4c50-92c7-8f731a421201 1073741824" returned: 0 in 0.930s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:22 devstack sudo[98370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.d3f9b629-4efa-4cf8-8942-a02a0575f199 Jul 09 10:09:22 devstack sudo[98370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-788b48a1-5c06-4c50-92c7-8f731a421201 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:22 devstack sudo[98372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-788b48a1-5c06-4c50-92c7-8f731a421201 Jul 09 10:09:22 devstack sudo[98372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-58653680-3946-4e93-8e98-0277a915a410 tempest-AttachVolumeNegativeTest-2008901733 None] Acquiring lock "cinder-a52214a6-c49f-424a-8914-36fbb1e0ca87-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-58653680-3946-4e93-8e98-0277a915a410 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "cinder-a52214a6-c49f-424a-8914-36fbb1e0ca87-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-58653680-3946-4e93-8e98-0277a915a410 tempest-AttachVolumeNegativeTest-2008901733 None] Acquiring lock "cinder-quobyte-a52214a6-c49f-424a-8914-36fbb1e0ca87" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-58653680-3946-4e93-8e98-0277a915a410 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "cinder-quobyte-a52214a6-c49f-424a-8914-36fbb1e0ca87" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d792251-599e-4955-b12b-ceb5ac9ecdb6]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:09:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58653680-3946-4e93-8e98-0277a915a410 tempest-AttachVolumeNegativeTest-2008901733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a52214a6-c49f-424a-8914-36fbb1e0ca87 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:23 devstack sudo[98364]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1dc30732-b349-4e62-aad2-7f9ff5cca028 tempest-AttachVolumeNegativeTest-2008901733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.817s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:23 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-1dc30732-b349-4e62-aad2-7f9ff5cca028 tempest-AttachVolumeNegativeTest-2008901733 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:09:23 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1dc30732-b349-4e62-aad2-7f9ff5cca028 tempest-AttachVolumeNegativeTest-2008901733 None] Deleted volume successfully. Jul 09 10:09:23 devstack sudo[98375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a52214a6-c49f-424a-8914-36fbb1e0ca87 Jul 09 10:09:23 devstack sudo[98375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1dc30732-b349-4e62-aad2-7f9ff5cca028 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "cinder-b8f42ef2-e5c4-4165-a75d-4830c8e6dec8-delete_volume" released by "delete_volume" :: held 2.656s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:09:23 devstack sudo[98370]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.d3f9b629-4efa-4cf8-8942-a02a0575f199" returned: 0 in 1.054s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:09:23 devstack sudo[98372]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-788b48a1-5c06-4c50-92c7-8f731a421201" returned: 0 in 0.927s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] <== create_volume: return (1925ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:09:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.928s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:23 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[585e8ec0-a00e-47b2-a32c-1fa1d71a6e05]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:09:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6139861f-816a-4f44-8afe-e2e113c08c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-788b48a1-5c06-4c50-92c7-8f731a421201', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f8599d-1676-40e2-9f77-1d8cef7d18bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:23 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Volume volume-788b48a1-5c06-4c50-92c7-8f731a421201 (788b48a1-5c06-4c50-92c7-8f731a421201): created successfully Jul 09 10:09:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88f8599d-1676-40e2-9f77-1d8cef7d18bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Flow 'volume_create_manager' (25eef30e-5533-457e-827d-a6c5392bad4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:09:23 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2c76db42-68b0-4de2-b157-ec8d164b4355 tempest-VolumeQuotasAdminTestJSON-359806090 None] Created volume successfully. Jul 09 10:09:23 devstack sudo[98381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883 Jul 09 10:09:23 devstack sudo[98381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:23 devstack sudo[98375]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58653680-3946-4e93-8e98-0277a915a410 tempest-AttachVolumeNegativeTest-2008901733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a52214a6-c49f-424a-8914-36fbb1e0ca87" returned: 0 in 0.920s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58653680-3946-4e93-8e98-0277a915a410 tempest-AttachVolumeNegativeTest-2008901733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a52214a6-c49f-424a-8914-36fbb1e0ca87 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:23 devstack sudo[98386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a52214a6-c49f-424a-8914-36fbb1e0ca87 Jul 09 10:09:23 devstack sudo[98386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:24 devstack sudo[98381]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883" returned: 0 in 0.850s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.d3f9b629-4efa-4cf8-8942-a02a0575f199 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:24 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.d3f9b629-4efa-4cf8-8942-a02a0575f199 Jul 09 10:09:24 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:24 devstack sudo[98386]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58653680-3946-4e93-8e98-0277a915a410 tempest-AttachVolumeNegativeTest-2008901733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a52214a6-c49f-424a-8914-36fbb1e0ca87" returned: 0 in 0.724s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-58653680-3946-4e93-8e98-0277a915a410 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "cinder-quobyte-a52214a6-c49f-424a-8914-36fbb1e0ca87" released by "delete_volume" :: held 1.732s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:09:24 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-58653680-3946-4e93-8e98-0277a915a410 tempest-AttachVolumeNegativeTest-2008901733 None] Created reservations ['aa8cab2d-9604-4de8-a991-2180e8d13d5d', 'f6ee798d-281e-4dda-ad73-a18ff4d5d19e', '99b7f62c-7bea-4086-9c71-239c2cfc508a', '7bed2cd8-088e-44b6-8bf0-1be0d7a021df'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:09:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-58653680-3946-4e93-8e98-0277a915a410 tempest-AttachVolumeNegativeTest-2008901733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-58653680-3946-4e93-8e98-0277a915a410 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-58653680-3946-4e93-8e98-0277a915a410 tempest-AttachVolumeNegativeTest-2008901733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:09:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-58653680-3946-4e93-8e98-0277a915a410 tempest-AttachVolumeNegativeTest-2008901733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:09:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-58653680-3946-4e93-8e98-0277a915a410 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58653680-3946-4e93-8e98-0277a915a410 tempest-AttachVolumeNegativeTest-2008901733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:25 devstack sudo[98422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:09:25 devstack sudo[98422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:25 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-15944960-7afb-4d50-bc26-9b0e05e2e551 tempest-VolumeQuotasAdminTestJSON-111267368 None] Transfer volume completed successfully. Jul 09 10:09:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-291172ad-306b-4752-a46e-b58022dd40ab tempest-AttachVolumeNegativeTest-2008901733 None] Acquiring lock "cinder-458fef2d-856d-427a-81e5-ee2e096ac3fa-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:09:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-291172ad-306b-4752-a46e-b58022dd40ab tempest-AttachVolumeNegativeTest-2008901733 None] Lock "cinder-458fef2d-856d-427a-81e5-ee2e096ac3fa-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:09:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-291172ad-306b-4752-a46e-b58022dd40ab tempest-AttachVolumeNegativeTest-2008901733 None] Acquiring lock "cinder-quobyte-458fef2d-856d-427a-81e5-ee2e096ac3fa" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:09:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-291172ad-306b-4752-a46e-b58022dd40ab tempest-AttachVolumeNegativeTest-2008901733 None] Lock "cinder-quobyte-458fef2d-856d-427a-81e5-ee2e096ac3fa" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:09:25 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[20d55ae6-15cb-400f-80c5-8f5def1858b4]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:09:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-291172ad-306b-4752-a46e-b58022dd40ab tempest-AttachVolumeNegativeTest-2008901733 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-458fef2d-856d-427a-81e5-ee2e096ac3fa {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:25 devstack sudo[98444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-458fef2d-856d-427a-81e5-ee2e096ac3fa Jul 09 10:09:25 devstack sudo[98444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:26 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.d3f9b629-4efa-4cf8-8942-a02a0575f199" returned: 0 in 1.537s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.d3f9b629-4efa-4cf8-8942-a02a0575f199 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:26 devstack sudo[98450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.d3f9b629-4efa-4cf8-8942-a02a0575f199 Jul 09 10:09:26 devstack sudo[98450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:26 devstack sudo[98422]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-58653680-3946-4e93-8e98-0277a915a410 tempest-AttachVolumeNegativeTest-2008901733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.100s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:26 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-58653680-3946-4e93-8e98-0277a915a410 tempest-AttachVolumeNegativeTest-2008901733 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:09:26 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-58653680-3946-4e93-8e98-0277a915a410 tempest-AttachVolumeNegativeTest-2008901733 None] Deleted volume successfully. Jul 09 10:09:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-58653680-3946-4e93-8e98-0277a915a410 tempest-AttachVolumeNegativeTest-2008901733 None] Lock "cinder-a52214a6-c49f-424a-8914-36fbb1e0ca87-delete_volume" released by "delete_volume" :: held 3.287s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:09:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e68c96fb-0d51-4fc2-aa17-ef23f11304bd tempest-VolumeQuotasAdminTestJSON-758667777 None] Acquiring lock "cinder-788b48a1-5c06-4c50-92c7-8f731a421201-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:09:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e68c96fb-0d51-4fc2-aa17-ef23f11304bd tempest-VolumeQuotasAdminTestJSON-758667777 None] Lock "cinder-788b48a1-5c06-4c50-92c7-8f731a421201-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:09:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e68c96fb-0d51-4fc2-aa17-ef23f11304bd tempest-VolumeQuotasAdminTestJSON-758667777 None] Acquiring lock "cinder-quobyte-788b48a1-5c06-4c50-92c7-8f731a421201" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:09:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e68c96fb-0d51-4fc2-aa17-ef23f11304bd tempest-VolumeQuotasAdminTestJSON-758667777 None] Lock "cinder-quobyte-788b48a1-5c06-4c50-92c7-8f731a421201" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:09:26 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1787a8c7-c1f8-476f-8a8c-f470109028c6]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:09:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e68c96fb-0d51-4fc2-aa17-ef23f11304bd tempest-VolumeQuotasAdminTestJSON-758667777 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-788b48a1-5c06-4c50-92c7-8f731a421201 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:26 devstack sudo[98450]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883.d3f9b629-4efa-4cf8-8942-a02a0575f199" returned: 0 in 0.880s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:26 devstack sudo[98444]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-291172ad-306b-4752-a46e-b58022dd40ab tempest-AttachVolumeNegativeTest-2008901733 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-458fef2d-856d-427a-81e5-ee2e096ac3fa" returned: 0 in 1.151s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-291172ad-306b-4752-a46e-b58022dd40ab tempest-AttachVolumeNegativeTest-2008901733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-458fef2d-856d-427a-81e5-ee2e096ac3fa {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Lock "cinder-quobyte-d3f9b629-4efa-4cf8-8942-a02a0575f199" released by "_delete_snapshot" :: held 4.473s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:09:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Lock "cinder-quobyte-0c77abcf-b0c7-441a-a6b0-ab73275ba883" released by "delete_snapshot" :: held 4.502s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:09:27 devstack sudo[98476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-458fef2d-856d-427a-81e5-ee2e096ac3fa Jul 09 10:09:27 devstack sudo[98476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:27 devstack sudo[98475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-788b48a1-5c06-4c50-92c7-8f731a421201 Jul 09 10:09:27 devstack sudo[98475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:27 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Created reservations ['f594280e-073e-48d2-87b0-e1109f94da5b', '85fe86f2-710f-44ac-8e74-bde6d6e6605d', 'c97bf022-a1a6-409a-9fd6-ecbf6b6bd7e5', 'ed6be0d1-89d6-44da-bb1a-d5b1d483f977'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:09:27 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Delete snapshot completed successfully. Jul 09 10:09:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5cd0bfce-071a-4533-9ee1-0559c1bffe8b tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Lock "cinder-d3f9b629-4efa-4cf8-8942-a02a0575f199-delete_snapshot" released by "delete_snapshot" :: held 4.652s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:09:27 devstack sudo[98475]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e68c96fb-0d51-4fc2-aa17-ef23f11304bd tempest-VolumeQuotasAdminTestJSON-758667777 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-788b48a1-5c06-4c50-92c7-8f731a421201" returned: 0 in 1.055s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e68c96fb-0d51-4fc2-aa17-ef23f11304bd tempest-VolumeQuotasAdminTestJSON-758667777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-788b48a1-5c06-4c50-92c7-8f731a421201 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:28 devstack sudo[98522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-788b48a1-5c06-4c50-92c7-8f731a421201 Jul 09 10:09:28 devstack sudo[98522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:28 devstack sudo[98476]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-291172ad-306b-4752-a46e-b58022dd40ab tempest-AttachVolumeNegativeTest-2008901733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-458fef2d-856d-427a-81e5-ee2e096ac3fa" returned: 0 in 1.026s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-291172ad-306b-4752-a46e-b58022dd40ab tempest-AttachVolumeNegativeTest-2008901733 None] Lock "cinder-quobyte-458fef2d-856d-427a-81e5-ee2e096ac3fa" released by "delete_volume" :: held 2.250s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:09:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7e420612-0173-48a7-a926-afa15cf87c81 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Acquiring lock "cinder-0c77abcf-b0c7-441a-a6b0-ab73275ba883-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:09:28 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-291172ad-306b-4752-a46e-b58022dd40ab tempest-AttachVolumeNegativeTest-2008901733 None] Created reservations ['9bd244cb-398a-4d82-a08e-05c049002092', '82c03e8a-55b2-42e3-a1e7-a2f2a6171ac1', 'cef0ab54-825f-49f8-8bc7-8cb42f4cc55f', '31a37b8a-efe3-4409-921f-a95edfc75455'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:09:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7e420612-0173-48a7-a926-afa15cf87c81 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Lock "cinder-0c77abcf-b0c7-441a-a6b0-ab73275ba883-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:09:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7e420612-0173-48a7-a926-afa15cf87c81 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Acquiring lock "cinder-quobyte-0c77abcf-b0c7-441a-a6b0-ab73275ba883" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:09:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7e420612-0173-48a7-a926-afa15cf87c81 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Lock "cinder-quobyte-0c77abcf-b0c7-441a-a6b0-ab73275ba883" acquired by "delete_volume" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:09:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-291172ad-306b-4752-a46e-b58022dd40ab tempest-AttachVolumeNegativeTest-2008901733 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-291172ad-306b-4752-a46e-b58022dd40ab tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-291172ad-306b-4752-a46e-b58022dd40ab tempest-AttachVolumeNegativeTest-2008901733 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:09:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-291172ad-306b-4752-a46e-b58022dd40ab tempest-AttachVolumeNegativeTest-2008901733 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:09:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-291172ad-306b-4752-a46e-b58022dd40ab tempest-AttachVolumeNegativeTest-2008901733 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-291172ad-306b-4752-a46e-b58022dd40ab tempest-AttachVolumeNegativeTest-2008901733 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:28 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcfd9901-63e2-42de-8a26-da74f9fe19c5]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:09:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7e420612-0173-48a7-a926-afa15cf87c81 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:28 devstack sudo[98524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:09:28 devstack sudo[98524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:28 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883 Jul 09 10:09:28 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:29 devstack sudo[98522]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e68c96fb-0d51-4fc2-aa17-ef23f11304bd tempest-VolumeQuotasAdminTestJSON-758667777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-788b48a1-5c06-4c50-92c7-8f731a421201" returned: 0 in 1.078s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e68c96fb-0d51-4fc2-aa17-ef23f11304bd tempest-VolumeQuotasAdminTestJSON-758667777 None] Lock "cinder-quobyte-788b48a1-5c06-4c50-92c7-8f731a421201" released by "delete_volume" :: held 2.239s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:09:29 devstack sudo[98524]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-291172ad-306b-4752-a46e-b58022dd40ab tempest-AttachVolumeNegativeTest-2008901733 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.799s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-291172ad-306b-4752-a46e-b58022dd40ab tempest-AttachVolumeNegativeTest-2008901733 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:09:29 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-291172ad-306b-4752-a46e-b58022dd40ab tempest-AttachVolumeNegativeTest-2008901733 None] Deleted volume successfully. Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-e68c96fb-0d51-4fc2-aa17-ef23f11304bd tempest-VolumeQuotasAdminTestJSON-758667777 None] Created reservations ['e8e0b819-b24e-4d20-a7fa-f208049558f6', '74637931-eb2b-4e7b-8b51-6274d637e881', '7d250dcd-6209-4cd3-b926-893502582f62', '0f54b018-5e21-4f8a-b192-9125949f6796'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-291172ad-306b-4752-a46e-b58022dd40ab tempest-AttachVolumeNegativeTest-2008901733 None] Lock "cinder-458fef2d-856d-427a-81e5-ee2e096ac3fa-delete_volume" released by "delete_volume" :: held 3.541s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e68c96fb-0d51-4fc2-aa17-ef23f11304bd tempest-VolumeQuotasAdminTestJSON-758667777 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e68c96fb-0d51-4fc2-aa17-ef23f11304bd tempest-VolumeQuotasAdminTestJSON-758667777 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e68c96fb-0d51-4fc2-aa17-ef23f11304bd tempest-VolumeQuotasAdminTestJSON-758667777 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e68c96fb-0d51-4fc2-aa17-ef23f11304bd tempest-VolumeQuotasAdminTestJSON-758667777 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e68c96fb-0d51-4fc2-aa17-ef23f11304bd tempest-VolumeQuotasAdminTestJSON-758667777 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e68c96fb-0d51-4fc2-aa17-ef23f11304bd tempest-VolumeQuotasAdminTestJSON-758667777 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:29 devstack sudo[98530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:09:29 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:29 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7e420612-0173-48a7-a926-afa15cf87c81 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883" returned: 0 in 1.438s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7e420612-0173-48a7-a926-afa15cf87c81 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:29 devstack sudo[98535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:09:29 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:29 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883 Jul 09 10:09:29 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:30 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e68c96fb-0d51-4fc2-aa17-ef23f11304bd tempest-VolumeQuotasAdminTestJSON-758667777 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.459s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-e68c96fb-0d51-4fc2-aa17-ef23f11304bd tempest-VolumeQuotasAdminTestJSON-758667777 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:09:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e68c96fb-0d51-4fc2-aa17-ef23f11304bd tempest-VolumeQuotasAdminTestJSON-758667777 None] Deleted volume successfully. Jul 09 10:09:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e68c96fb-0d51-4fc2-aa17-ef23f11304bd tempest-VolumeQuotasAdminTestJSON-758667777 None] Lock "cinder-788b48a1-5c06-4c50-92c7-8f731a421201-delete_volume" released by "delete_volume" :: held 4.182s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:09:31 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7e420612-0173-48a7-a926-afa15cf87c81 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0c77abcf-b0c7-441a-a6b0-ab73275ba883" returned: 0 in 1.441s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7e420612-0173-48a7-a926-afa15cf87c81 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Lock "cinder-quobyte-0c77abcf-b0c7-441a-a6b0-ab73275ba883" released by "delete_volume" :: held 2.964s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:09:31 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-7e420612-0173-48a7-a926-afa15cf87c81 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Created reservations ['f40f2572-bbc5-49f6-b03a-50a759762437', 'be990e59-a618-4183-9e2f-d7943b52fc17', '3fed1dd0-18c5-4da5-a1e5-9c90276dd85a', 'c6b0c3a3-2904-49b1-bfc8-29c6b0e27034'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:09:31 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.748s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:31 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:09:31 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:09:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:09:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:09:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7e420612-0173-48a7-a926-afa15cf87c81 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7e420612-0173-48a7-a926-afa15cf87c81 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7e420612-0173-48a7-a926-afa15cf87c81 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:09:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7e420612-0173-48a7-a926-afa15cf87c81 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:09:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7e420612-0173-48a7-a926-afa15cf87c81 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7e420612-0173-48a7-a926-afa15cf87c81 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:31 devstack sudo[98543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:09:31 devstack sudo[98543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:32 devstack sudo[98543]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7e420612-0173-48a7-a926-afa15cf87c81 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.948s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:32 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-7e420612-0173-48a7-a926-afa15cf87c81 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:09:32 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7e420612-0173-48a7-a926-afa15cf87c81 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Deleted volume successfully. Jul 09 10:09:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7e420612-0173-48a7-a926-afa15cf87c81 tempest-VolumesSnapshotNegativeTestJSON-1287324898 None] Lock "cinder-0c77abcf-b0c7-441a-a6b0-ab73275ba883-delete_volume" released by "delete_volume" :: held 4.362s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:09:41 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:DELETE=4,cinder:SELECT=27,cinder:INSERT=12,cinder:UPDATE=47 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:09:42 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=36,cinder:INSERT=13,cinder:UPDATE=49,cinder:DELETE=3 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:09:53 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e54023bc-7248-49b9-8ecd-5a1c04bc4635 tempest-GroupsTest-5514105 None] Group tempest-Group1-245611818: creating Jul 09 10:09:53 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e54023bc-7248-49b9-8ecd-5a1c04bc4635 tempest-GroupsTest-5514105 None] Group tempest-Group1-245611818: created successfully Jul 09 10:09:53 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e54023bc-7248-49b9-8ecd-5a1c04bc4635 tempest-GroupsTest-5514105 None] Create group completed successfully. Jul 09 10:09:54 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-09f5b1c7-55ac-4c90-86ea-43876e340acc tempest-GroupsTest-5514105 None] Group tempest-Group2-415273242: creating Jul 09 10:09:54 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-09f5b1c7-55ac-4c90-86ea-43876e340acc tempest-GroupsTest-5514105 None] Group tempest-Group2-415273242: created successfully Jul 09 10:09:54 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-09f5b1c7-55ac-4c90-86ea-43876e340acc tempest-GroupsTest-5514105 None] Create group completed successfully. Jul 09 10:09:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-3b99a156-9414-4dd3-bc70-f20135c3af52 req-1001444b-97d2-416f-a69d-fccf7ba53a08 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-3b99a156-9414-4dd3-bc70-f20135c3af52 req-1001444b-97d2-416f-a69d-fccf7ba53a08 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:55 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[df05f75d-5dbf-4d05-9c25-9dda54e71226]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:09:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-3b99a156-9414-4dd3-bc70-f20135c3af52 req-1001444b-97d2-416f-a69d-fccf7ba53a08 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27c58790-b2b1-481e-953f-123890292b5c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:56 devstack sudo[98597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27c58790-b2b1-481e-953f-123890292b5c Jul 09 10:09:56 devstack sudo[98597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:56 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:09:56 devstack sudo[98597]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Flow 'volume_create_manager' (58eab6a9-5d4d-4765-af7a-3f2f1ccc7433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9bde007-9c83-4399-9b24-7d31d4359211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-3b99a156-9414-4dd3-bc70-f20135c3af52 req-1001444b-97d2-416f-a69d-fccf7ba53a08 tempest-TestServerVolumeAttachmentScenario-1971854153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27c58790-b2b1-481e-953f-123890292b5c" returned: 0 in 1.136s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-3b99a156-9414-4dd3-bc70-f20135c3af52 req-1001444b-97d2-416f-a69d-fccf7ba53a08 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.170s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9bde007-9c83-4399-9b24-7d31d4359211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1392691009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84ec1562-8d21-4918-8039-00a241cff3e6,host='devstack@QuobyteHD#QuobyteHD',id=69d45bba-c69b-40e5-8685-a37064f536e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6527ae4c244437998819cf985d25a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:09:57Z,use_quota=True,user_id='4e105dc5e4204b76a0877e14937b8a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78067dba-9daa-49c2-a372-55dcf40e65ae),volume_type_id=78067dba-9daa-49c2-a372-55dcf40e65ae)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b970d6-44a4-416f-90d7-63d7ea0a1916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (38b970d6-44a4-416f-90d7-63d7ea0a1916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3afb89a-e17c-4c35-978b-4b6d4e7dc649) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3afb89a-e17c-4c35-978b-4b6d4e7dc649) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '69d45bba-c69b-40e5-8685-a37064f536e6', 'volume_name': 'volume-69d45bba-c69b-40e5-8685-a37064f536e6', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4435f0df-c1e0-4b5c-83ba-6140d3bafbc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4435f0df-c1e0-4b5c-83ba-6140d3bafbc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e8f5cd-deb7-41bf-8544-2232f9cf2cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Volume 69d45bba-c69b-40e5-8685-a37064f536e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-69d45bba-c69b-40e5-8685-a37064f536e6', 'volume_size': 1} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=84ec1562-8d21-4918-8039-00a241cff3e6,created_at=2026-07-09T08:09:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1392691009',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=84ec1562-8d21-4918-8039-00a241cff3e6,host='devstack@QuobyteHD#QuobyteHD',id=69d45bba-c69b-40e5-8685-a37064f536e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6527ae4c244437998819cf985d25a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:09:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:09:57Z,use_quota=True,user_id='4e105dc5e4204b76a0877e14937b8a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78067dba-9daa-49c2-a372-55dcf40e65ae),volume_type_id=78067dba-9daa-49c2-a372-55dcf40e65ae)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Creating volume 69d45bba-c69b-40e5-8685-a37064f536e6 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:09:57 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-69d45bba-c69b-40e5-8685-a37064f536e6 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:57 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-69d45bba-c69b-40e5-8685-a37064f536e6 1073741824 Jul 09 10:09:57 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-3b99a156-9414-4dd3-bc70-f20135c3af52 req-1001444b-97d2-416f-a69d-fccf7ba53a08 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-27c58790-b2b1-481e-953f-123890292b5c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '42c8f51c-82b3-4cba-93c2-a3f690966bed', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:09:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-3b99a156-9414-4dd3-bc70-f20135c3af52 req-1001444b-97d2-416f-a69d-fccf7ba53a08 tempest-TestServerVolumeAttachmentScenario-1971854153 None] attachment_update completed successfully. Jul 09 10:09:58 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-69d45bba-c69b-40e5-8685-a37064f536e6 1073741824" returned: 0 in 1.210s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-69d45bba-c69b-40e5-8685-a37064f536e6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:09:58 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-69d45bba-c69b-40e5-8685-a37064f536e6 Jul 09 10:09:58 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:09:59 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Jul 09 10:09:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-69d45bba-c69b-40e5-8685-a37064f536e6" returned: 0 in 1.032s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:09:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] <== create_volume: return (2303ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:09:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.308s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:09:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22e8f5cd-deb7-41bf-8544-2232f9cf2cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-69d45bba-c69b-40e5-8685-a37064f536e6', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03001969-78dd-4bcb-8457-9fc23444c9c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:09:59 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Volume volume-69d45bba-c69b-40e5-8685-a37064f536e6 (69d45bba-c69b-40e5-8685-a37064f536e6): created successfully Jul 09 10:09:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03001969-78dd-4bcb-8457-9fc23444c9c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:09:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Flow 'volume_create_manager' (58eab6a9-5d4d-4765-af7a-3f2f1ccc7433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:09:59 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e108d229-f381-4268-9769-e7c1e3901694 tempest-GroupsTest-5514105 None] Created volume successfully. Jul 09 10:10:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2ab87839-fc6d-47d7-8879-7ff157a64cea tempest-GroupsTest-5514105 None] Acquiring lock "cinder-quobyte-69d45bba-c69b-40e5-8685-a37064f536e6" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2ab87839-fc6d-47d7-8879-7ff157a64cea tempest-GroupsTest-5514105 None] Lock "cinder-quobyte-69d45bba-c69b-40e5-8685-a37064f536e6" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:01 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1490081-8493-48ee-a1f3-18959a75c8b9]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ab87839-fc6d-47d7-8879-7ff157a64cea tempest-GroupsTest-5514105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-69d45bba-c69b-40e5-8685-a37064f536e6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:01 devstack sudo[98993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-69d45bba-c69b-40e5-8685-a37064f536e6 Jul 09 10:10:01 devstack sudo[98993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:02 devstack sudo[98993]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ab87839-fc6d-47d7-8879-7ff157a64cea tempest-GroupsTest-5514105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-69d45bba-c69b-40e5-8685-a37064f536e6" returned: 0 in 0.912s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ab87839-fc6d-47d7-8879-7ff157a64cea tempest-GroupsTest-5514105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-69d45bba-c69b-40e5-8685-a37064f536e6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:02 devstack sudo[99000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-69d45bba-c69b-40e5-8685-a37064f536e6 Jul 09 10:10:02 devstack sudo[99000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:03 devstack sudo[99000]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ab87839-fc6d-47d7-8879-7ff157a64cea tempest-GroupsTest-5514105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-69d45bba-c69b-40e5-8685-a37064f536e6" returned: 0 in 0.817s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2ab87839-fc6d-47d7-8879-7ff157a64cea tempest-GroupsTest-5514105 None] Lock "cinder-quobyte-69d45bba-c69b-40e5-8685-a37064f536e6" released by "delete_volume" :: held 1.781s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-2ab87839-fc6d-47d7-8879-7ff157a64cea tempest-GroupsTest-5514105 None] Created reservations ['03876807-0138-4c19-a8b2-bad86400e4da'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:10:03 devstack cinder-volume[87192]: WARNING cinder.quota [None req-2ab87839-fc6d-47d7-8879-7ff157a64cea tempest-GroupsTest-5514105 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-989035218 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-989035218, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:10:03 devstack cinder-volume[87192]: WARNING cinder.quota [None req-2ab87839-fc6d-47d7-8879-7ff157a64cea tempest-GroupsTest-5514105 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-989035218 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-989035218, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-2ab87839-fc6d-47d7-8879-7ff157a64cea tempest-GroupsTest-5514105 None] Created reservations ['79bcc62c-9d78-41ee-ae3a-0610575697e3', '381702d4-3e7c-426f-be50-03cf59b2c6c2', '8ec0ffdf-b004-4031-9fb1-109d06a15fb5', 'db6d43d6-89e1-453f-bf69-5332a382f6db'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ab87839-fc6d-47d7-8879-7ff157a64cea tempest-GroupsTest-5514105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ab87839-fc6d-47d7-8879-7ff157a64cea tempest-GroupsTest-5514105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2ab87839-fc6d-47d7-8879-7ff157a64cea tempest-GroupsTest-5514105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2ab87839-fc6d-47d7-8879-7ff157a64cea tempest-GroupsTest-5514105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2ab87839-fc6d-47d7-8879-7ff157a64cea tempest-GroupsTest-5514105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ab87839-fc6d-47d7-8879-7ff157a64cea tempest-GroupsTest-5514105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:03 devstack sudo[99005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:10:03 devstack sudo[99005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Flow 'volume_create_manager' (99eaef84-b40e-4454-8838-0f4a945a1a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d9c6c3-ca81-4cf9-acbb-be25e93a0958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6d9c6c3-ca81-4cf9-acbb-be25e93a0958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1792187388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d9b5a5-005a-470f-a250-a3efb99964b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b7ff3e3b37644b0949c14c4ae3799a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:04Z,use_quota=True,user_id='caf4810aee2b4b1faa1b27d1d81d39ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1916f9bb-3ea3-4a03-b3b7-4fab2a0e5686) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1916f9bb-3ea3-4a03-b3b7-4fab2a0e5686) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36fcb14-c80e-4a2b-989d-da0304487439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c36fcb14-c80e-4a2b-989d-da0304487439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4d9b5a5-005a-470f-a250-a3efb99964b0', 'volume_name': 'volume-e4d9b5a5-005a-470f-a250-a3efb99964b0', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d2d9be-912e-4162-b67f-c41dd17678ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01d2d9be-912e-4162-b67f-c41dd17678ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d327e121-bb02-4c87-8d9c-350f2923ea3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:03 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Volume e4d9b5a5-005a-470f-a250-a3efb99964b0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4d9b5a5-005a-470f-a250-a3efb99964b0', 'volume_size': 1} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:10:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1792187388',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4d9b5a5-005a-470f-a250-a3efb99964b0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b7ff3e3b37644b0949c14c4ae3799a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:04Z,use_quota=True,user_id='caf4810aee2b4b1faa1b27d1d81d39ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Creating volume e4d9b5a5-005a-470f-a250-a3efb99964b0 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:10:03 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:10:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:03 devstack sudo[99007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 1073741824 Jul 09 10:10:03 devstack sudo[99007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:04 devstack sudo[99005]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2ab87839-fc6d-47d7-8879-7ff157a64cea tempest-GroupsTest-5514105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.870s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:04 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-2ab87839-fc6d-47d7-8879-7ff157a64cea tempest-GroupsTest-5514105 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:10:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2ab87839-fc6d-47d7-8879-7ff157a64cea tempest-GroupsTest-5514105 None] Delete group completed successfully. Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Flow 'volume_create_manager' (b25722ad-56ae-4722-8b97-c81c90413b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1a6307-788b-45fa-aeef-e032cd685ce6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1a6307-788b-45fa-aeef-e032cd685ce6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1984355869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=583dbf51-d23c-44af-b0c0-96856263e9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7705ea83fadf40b1ad4d6d7132310e79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:05Z,use_quota=True,user_id='3c6b5d3430994621a2596b23b5fc9a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986d39c2-5add-434b-bf64-8743e784f46a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (986d39c2-5add-434b-bf64-8743e784f46a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886bdc49-7fda-4263-a69a-75662704327b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (886bdc49-7fda-4263-a69a-75662704327b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '583dbf51-d23c-44af-b0c0-96856263e9f6', 'volume_name': 'volume-583dbf51-d23c-44af-b0c0-96856263e9f6', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3f0447-d48e-45a2-9959-251376d08da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d3f0447-d48e-45a2-9959-251376d08da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bddb609-0f6a-41a8-9751-f786185e6694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:05 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Volume 583dbf51-d23c-44af-b0c0-96856263e9f6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-583dbf51-d23c-44af-b0c0-96856263e9f6', 'volume_size': 1} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:05 devstack sudo[99007]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 1073741824" returned: 0 in 1.268s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-f53bee0b-4ed2-4cb6-b7ee-ab35ea99acd9 tempest-GroupsTest-5514105 None] Created reservations ['aea8ab0f-d743-402a-bfd9-5b1e437a10b5'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:05 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 Jul 09 10:10:05 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f53bee0b-4ed2-4cb6-b7ee-ab35ea99acd9 tempest-GroupsTest-5514105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f53bee0b-4ed2-4cb6-b7ee-ab35ea99acd9 tempest-GroupsTest-5514105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f53bee0b-4ed2-4cb6-b7ee-ab35ea99acd9 tempest-GroupsTest-5514105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f53bee0b-4ed2-4cb6-b7ee-ab35ea99acd9 tempest-GroupsTest-5514105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f53bee0b-4ed2-4cb6-b7ee-ab35ea99acd9 tempest-GroupsTest-5514105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f53bee0b-4ed2-4cb6-b7ee-ab35ea99acd9 tempest-GroupsTest-5514105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:05 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:10:05 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0" returned: 0 in 0.759s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] <== create_volume: return (2102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.107s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.867s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:05 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:10:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1984355869',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=583dbf51-d23c-44af-b0c0-96856263e9f6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7705ea83fadf40b1ad4d6d7132310e79',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:05Z,use_quota=True,user_id='3c6b5d3430994621a2596b23b5fc9a72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Creating volume 583dbf51-d23c-44af-b0c0-96856263e9f6 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:10:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:10:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:10:06 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:10:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:06 devstack sudo[99025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6 1073741824 Jul 09 10:10:06 devstack sudo[99025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d327e121-bb02-4c87-8d9c-350f2923ea3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4d9b5a5-005a-470f-a250-a3efb99964b0', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fca7f97-f996-4579-b6c2-4bd44d5e84f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:06 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Volume volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 (e4d9b5a5-005a-470f-a250-a3efb99964b0): created successfully Jul 09 10:10:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fca7f97-f996-4579-b6c2-4bd44d5e84f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Flow 'volume_create_manager' (99eaef84-b40e-4454-8838-0f4a945a1a50) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:10:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-efa5a533-3b4b-4fa0-a705-d0f889f4c023 tempest-TestStampPattern-1520710234 None] Created volume successfully. Jul 09 10:10:06 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f53bee0b-4ed2-4cb6-b7ee-ab35ea99acd9 tempest-GroupsTest-5514105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.989s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:06 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-f53bee0b-4ed2-4cb6-b7ee-ab35ea99acd9 tempest-GroupsTest-5514105 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:10:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f53bee0b-4ed2-4cb6-b7ee-ab35ea99acd9 tempest-GroupsTest-5514105 None] Delete group completed successfully. Jul 09 10:10:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ec646792-0931-4f59-a730-60ad56b52a01 tempest-GroupsTest-5514105 None] Group tempest-GroupsTest-Group-29583410: creating Jul 09 10:10:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ec646792-0931-4f59-a730-60ad56b52a01 tempest-GroupsTest-5514105 None] Group tempest-GroupsTest-Group-29583410: created successfully Jul 09 10:10:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ec646792-0931-4f59-a730-60ad56b52a01 tempest-GroupsTest-5514105 None] Create group completed successfully. Jul 09 10:10:07 devstack sudo[99025]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6 1073741824" returned: 0 in 1.018s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:07 devstack sudo[99034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6 Jul 09 10:10:07 devstack sudo[99034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:07 devstack sudo[99034]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6" returned: 0 in 0.668s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] <== create_volume: return (1745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:10:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bddb609-0f6a-41a8-9751-f786185e6694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-583dbf51-d23c-44af-b0c0-96856263e9f6', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fac3ea-1bca-4a53-997d-18561684a9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:07 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Volume volume-583dbf51-d23c-44af-b0c0-96856263e9f6 (583dbf51-d23c-44af-b0c0-96856263e9f6): created successfully Jul 09 10:10:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4fac3ea-1bca-4a53-997d-18561684a9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Flow 'volume_create_manager' (b25722ad-56ae-4722-8b97-c81c90413b2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:10:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b68656b2-bccb-4ce3-99de-b526ead5efd5 tempest-SnapshotMetadataTestJSON-1913378401 None] Created volume successfully. Jul 09 10:10:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9dd764b3-7adf-4693-9541-99d6c1b6d4fc tempest-SnapshotMetadataTestJSON-1913378401 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9dd764b3-7adf-4693-9541-99d6c1b6d4fc tempest-SnapshotMetadataTestJSON-1913378401 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9dd764b3-7adf-4693-9541-99d6c1b6d4fc tempest-SnapshotMetadataTestJSON-1913378401 None] Creating offline snapshot 4e916959-4f3e-48cf-8eb3-5981fd9208f0 of volume 583dbf51-d23c-44af-b0c0-96856263e9f6 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:10:08 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:10:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Flow 'volume_create_manager' (aa71b0f6-13dd-4131-9c0a-f11c49c2f7c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:10:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10db52b0-7a68-4a9a-ad95-214bb6b637ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:08 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9aaca99e-59d6-4462-98ce-443a80c26b13]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9dd764b3-7adf-4693-9541-99d6c1b6d4fc tempest-SnapshotMetadataTestJSON-1913378401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10db52b0-7a68-4a9a-ad95-214bb6b637ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1637697532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ad6c72ef-b362-4ead-8e08-dadb392f9381,host='devstack@QuobyteHD#QuobyteHD',id=7607565a-c041-4acf-9462-2851034ab89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6527ae4c244437998819cf985d25a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:08Z,use_quota=True,user_id='4e105dc5e4204b76a0877e14937b8a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25a59505-1c4b-447f-84b7-95f5214d5b16),volume_type_id=25a59505-1c4b-447f-84b7-95f5214d5b16)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605e2529-cab8-4314-a4df-28b9cc88a00d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (605e2529-cab8-4314-a4df-28b9cc88a00d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3364e89-b79f-449f-8779-888420119bac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3364e89-b79f-449f-8779-888420119bac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7607565a-c041-4acf-9462-2851034ab89c', 'volume_name': 'volume-7607565a-c041-4acf-9462-2851034ab89c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92833892-48bb-4e64-9673-d08fb7017e7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (92833892-48bb-4e64-9673-d08fb7017e7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6388a549-ba89-4741-81ba-4210bc4a8761) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Volume 7607565a-c041-4acf-9462-2851034ab89c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7607565a-c041-4acf-9462-2851034ab89c', 'volume_size': 1} Jul 09 10:10:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:08 devstack sudo[99038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6 Jul 09 10:10:08 devstack sudo[99038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:09 devstack sudo[99038]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9dd764b3-7adf-4693-9541-99d6c1b6d4fc tempest-SnapshotMetadataTestJSON-1913378401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6" returned: 0 in 0.792s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9dd764b3-7adf-4693-9541-99d6c1b6d4fc tempest-SnapshotMetadataTestJSON-1913378401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.4e916959-4f3e-48cf-8eb3-5981fd9208f0 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:09 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.4e916959-4f3e-48cf-8eb3-5981fd9208f0 1G Jul 09 10:10:09 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-c4b45a53-73ac-4e4f-b0cb-e69a6625f635 req-68f4af09-f8d9-43ce-aa4e-130fdac8f086 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:10 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9dd764b3-7adf-4693-9541-99d6c1b6d4fc tempest-SnapshotMetadataTestJSON-1913378401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.4e916959-4f3e-48cf-8eb3-5981fd9208f0 1G" returned: 0 in 0.857s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9dd764b3-7adf-4693-9541-99d6c1b6d4fc tempest-SnapshotMetadataTestJSON-1913378401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-583dbf51-d23c-44af-b0c0-96856263e9f6 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.4e916959-4f3e-48cf-8eb3-5981fd9208f0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:10 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-583dbf51-d23c-44af-b0c0-96856263e9f6 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.4e916959-4f3e-48cf-8eb3-5981fd9208f0 Jul 09 10:10:10 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:10 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9dd764b3-7adf-4693-9541-99d6c1b6d4fc tempest-SnapshotMetadataTestJSON-1913378401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-583dbf51-d23c-44af-b0c0-96856263e9f6 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.4e916959-4f3e-48cf-8eb3-5981fd9208f0" returned: 0 in 0.771s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:10 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-9dd764b3-7adf-4693-9541-99d6c1b6d4fc tempest-SnapshotMetadataTestJSON-1913378401 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.4e916959-4f3e-48cf-8eb3-5981fd9208f0 is being set with open permissions: ugo+rw Jul 09 10:10:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9dd764b3-7adf-4693-9541-99d6c1b6d4fc tempest-SnapshotMetadataTestJSON-1913378401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.4e916959-4f3e-48cf-8eb3-5981fd9208f0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:10 devstack sudo[99064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.4e916959-4f3e-48cf-8eb3-5981fd9208f0 Jul 09 10:10:10 devstack sudo[99064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:11 devstack sudo[99064]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9dd764b3-7adf-4693-9541-99d6c1b6d4fc tempest-SnapshotMetadataTestJSON-1913378401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.4e916959-4f3e-48cf-8eb3-5981fd9208f0" returned: 0 in 0.692s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9dd764b3-7adf-4693-9541-99d6c1b6d4fc tempest-SnapshotMetadataTestJSON-1913378401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:11 devstack sudo[99067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.info Jul 09 10:10:11 devstack sudo[99067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:12 devstack sudo[99067]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9dd764b3-7adf-4693-9541-99d6c1b6d4fc tempest-SnapshotMetadataTestJSON-1913378401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.info" returned: 0 in 0.739s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:12 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-9dd764b3-7adf-4693-9541-99d6c1b6d4fc tempest-SnapshotMetadataTestJSON-1913378401 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.info is being set with open permissions: ugo+rw Jul 09 10:10:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9dd764b3-7adf-4693-9541-99d6c1b6d4fc tempest-SnapshotMetadataTestJSON-1913378401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:12 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.info Jul 09 10:10:12 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:13 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9dd764b3-7adf-4693-9541-99d6c1b6d4fc tempest-SnapshotMetadataTestJSON-1913378401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.info" returned: 0 in 0.684s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9dd764b3-7adf-4693-9541-99d6c1b6d4fc tempest-SnapshotMetadataTestJSON-1913378401 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.658s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.536s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ad6c72ef-b362-4ead-8e08-dadb392f9381,created_at=2026-07-09T08:10:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1637697532',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ad6c72ef-b362-4ead-8e08-dadb392f9381,host='devstack@QuobyteHD#QuobyteHD',id=7607565a-c041-4acf-9462-2851034ab89c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6527ae4c244437998819cf985d25a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:08Z,use_quota=True,user_id='4e105dc5e4204b76a0877e14937b8a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25a59505-1c4b-447f-84b7-95f5214d5b16),volume_type_id=25a59505-1c4b-447f-84b7-95f5214d5b16)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:10:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Creating volume 7607565a-c041-4acf-9462-2851034ab89c {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:10:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:10:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:10:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:10:13 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:10:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7607565a-c041-4acf-9462-2851034ab89c 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:13 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7607565a-c041-4acf-9462-2851034ab89c 1073741824 Jul 09 10:10:13 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:13 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9dd764b3-7adf-4693-9541-99d6c1b6d4fc tempest-SnapshotMetadataTestJSON-1913378401 None] Create snapshot completed successfully Jul 09 10:10:14 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7607565a-c041-4acf-9462-2851034ab89c 1073741824" returned: 0 in 0.940s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7607565a-c041-4acf-9462-2851034ab89c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:14 devstack sudo[99095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7607565a-c041-4acf-9462-2851034ab89c Jul 09 10:10:14 devstack sudo[99095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] Acquiring lock "cinder-4e916959-4f3e-48cf-8eb3-5981fd9208f0-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] Lock "cinder-4e916959-4f3e-48cf-8eb3-5981fd9208f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] Acquiring lock "cinder-quobyte-583dbf51-d23c-44af-b0c0-96856263e9f6" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] Lock "cinder-quobyte-583dbf51-d23c-44af-b0c0-96856263e9f6" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] Acquiring lock "cinder-quobyte-4e916959-4f3e-48cf-8eb3-5981fd9208f0" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] Lock "cinder-quobyte-4e916959-4f3e-48cf-8eb3-5981fd9208f0" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] Deleting offline snapshot 4e916959-4f3e-48cf-8eb3-5981fd9208f0 of volume 583dbf51-d23c-44af-b0c0-96856263e9f6 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] snapshot_file for this snap is: volume-583dbf51-d23c-44af-b0c0-96856263e9f6.4e916959-4f3e-48cf-8eb3-5981fd9208f0 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6640ad31-62ac-4c7e-83fb-8f259c856a6d]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.4e916959-4f3e-48cf-8eb3-5981fd9208f0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:14 devstack sudo[99097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.4e916959-4f3e-48cf-8eb3-5981fd9208f0 Jul 09 10:10:14 devstack sudo[99097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:14 devstack sudo[99095]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7607565a-c041-4acf-9462-2851034ab89c" returned: 0 in 0.690s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.678s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-c4b45a53-73ac-4e4f-b0cb-e69a6625f635 req-68f4af09-f8d9-43ce-aa4e-130fdac8f086 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.200s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6388a549-ba89-4741-81ba-4210bc4a8761) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7607565a-c041-4acf-9462-2851034ab89c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032ff472-1315-4ee7-9704-372f09abda7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[76e7e177-ada8-43bf-8ff1-45cac94b029d]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-c4b45a53-73ac-4e4f-b0cb-e69a6625f635 req-68f4af09-f8d9-43ce-aa4e-130fdac8f086 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-84b69108-98eb-4162-b53b-9de5bb423074 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:14 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Volume volume-7607565a-c041-4acf-9462-2851034ab89c (7607565a-c041-4acf-9462-2851034ab89c): created successfully Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (032ff472-1315-4ee7-9704-372f09abda7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Flow 'volume_create_manager' (aa71b0f6-13dd-4131-9c0a-f11c49c2f7c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:10:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0e603d0a-1417-4f2f-8c1b-f174b7b116be tempest-GroupsTest-5514105 None] Created volume successfully. Jul 09 10:10:14 devstack sudo[99100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-84b69108-98eb-4162-b53b-9de5bb423074 Jul 09 10:10:14 devstack sudo[99100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:15 devstack sudo[99097]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.4e916959-4f3e-48cf-8eb3-5981fd9208f0" returned: 0 in 0.963s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-583dbf51-d23c-44af-b0c0-96856263e9f6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:10:15 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f885791e-b134-49c5-83b9-badc6e929817]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:15 devstack sudo[99136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6 Jul 09 10:10:15 devstack sudo[99136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:15 devstack sudo[99100]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-c4b45a53-73ac-4e4f-b0cb-e69a6625f635 req-68f4af09-f8d9-43ce-aa4e-130fdac8f086 tempest-TestServerVolumeAttachmentScenario-1971854153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-84b69108-98eb-4162-b53b-9de5bb423074" returned: 0 in 1.067s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-c4b45a53-73ac-4e4f-b0cb-e69a6625f635 req-68f4af09-f8d9-43ce-aa4e-130fdac8f086 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.100s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-c4b45a53-73ac-4e4f-b0cb-e69a6625f635 req-68f4af09-f8d9-43ce-aa4e-130fdac8f086 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-84b69108-98eb-4162-b53b-9de5bb423074', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0a64b490-dc76-4820-a06b-9c2142db3ac7', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:10:15 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-c4b45a53-73ac-4e4f-b0cb-e69a6625f635 req-68f4af09-f8d9-43ce-aa4e-130fdac8f086 tempest-TestServerVolumeAttachmentScenario-1971854153 None] attachment_update completed successfully. Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Flow 'volume_create_manager' (7455a780-4c16-4178-8ee6-8e5df3e6b949) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d0c11a-7b78-4839-aa76-3af66ef7e42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87d0c11a-7b78-4839-aa76-3af66ef7e42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1676365550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ad6c72ef-b362-4ead-8e08-dadb392f9381,host='devstack@QuobyteHD#QuobyteHD',id=8be60a32-1b5b-49ab-a673-4b8ad582f94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6527ae4c244437998819cf985d25a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:16Z,use_quota=True,user_id='4e105dc5e4204b76a0877e14937b8a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25a59505-1c4b-447f-84b7-95f5214d5b16),volume_type_id=25a59505-1c4b-447f-84b7-95f5214d5b16)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86063e9-2cd0-403b-b282-505416449f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f86063e9-2cd0-403b-b282-505416449f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33c2cf8-a0b8-4342-a881-af2e0fb5d8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33c2cf8-a0b8-4342-a881-af2e0fb5d8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8be60a32-1b5b-49ab-a673-4b8ad582f94c', 'volume_name': 'volume-8be60a32-1b5b-49ab-a673-4b8ad582f94c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4bb283-3a25-46bf-8137-5dec4ba2380f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4bb283-3a25-46bf-8137-5dec4ba2380f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a02fbda-9b21-4732-a614-2933ccde5b36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:16 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Volume 8be60a32-1b5b-49ab-a673-4b8ad582f94c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8be60a32-1b5b-49ab-a673-4b8ad582f94c', 'volume_size': 1} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ad6c72ef-b362-4ead-8e08-dadb392f9381,created_at=2026-07-09T08:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1676365550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ad6c72ef-b362-4ead-8e08-dadb392f9381,host='devstack@QuobyteHD#QuobyteHD',id=8be60a32-1b5b-49ab-a673-4b8ad582f94c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b6527ae4c244437998819cf985d25a2d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:16Z,use_quota=True,user_id='4e105dc5e4204b76a0877e14937b8a70',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(25a59505-1c4b-447f-84b7-95f5214d5b16),volume_type_id=25a59505-1c4b-447f-84b7-95f5214d5b16)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Creating volume 8be60a32-1b5b-49ab-a673-4b8ad582f94c {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:10:16 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8be60a32-1b5b-49ab-a673-4b8ad582f94c 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:16 devstack sudo[99157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8be60a32-1b5b-49ab-a673-4b8ad582f94c 1073741824 Jul 09 10:10:16 devstack sudo[99157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:16 devstack sudo[99136]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6" returned: 0 in 1.168s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.4e916959-4f3e-48cf-8eb3-5981fd9208f0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:16 devstack sudo[99162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.4e916959-4f3e-48cf-8eb3-5981fd9208f0 Jul 09 10:10:16 devstack sudo[99162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:17 devstack sudo[99157]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8be60a32-1b5b-49ab-a673-4b8ad582f94c 1073741824" returned: 0 in 0.997s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8be60a32-1b5b-49ab-a673-4b8ad582f94c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:17 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8be60a32-1b5b-49ab-a673-4b8ad582f94c Jul 09 10:10:17 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:17 devstack sudo[99162]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.4e916959-4f3e-48cf-8eb3-5981fd9208f0" returned: 0 in 0.919s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.4e916959-4f3e-48cf-8eb3-5981fd9208f0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:17 devstack sudo[99195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.4e916959-4f3e-48cf-8eb3-5981fd9208f0 Jul 09 10:10:17 devstack sudo[99195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:18 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8be60a32-1b5b-49ab-a673-4b8ad582f94c" returned: 0 in 0.800s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] <== create_volume: return (1842ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:10:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.847s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a02fbda-9b21-4732-a614-2933ccde5b36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8be60a32-1b5b-49ab-a673-4b8ad582f94c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39373ba0-0aa3-4306-82b7-5e8a67fb9e24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:18 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Volume volume-8be60a32-1b5b-49ab-a673-4b8ad582f94c (8be60a32-1b5b-49ab-a673-4b8ad582f94c): created successfully Jul 09 10:10:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39373ba0-0aa3-4306-82b7-5e8a67fb9e24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Flow 'volume_create_manager' (7455a780-4c16-4178-8ee6-8e5df3e6b949) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:10:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f56a5de9-46b6-4e44-9658-48cb7d5ce1ce tempest-GroupsTest-5514105 None] Created volume successfully. Jul 09 10:10:18 devstack sudo[99195]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6.4e916959-4f3e-48cf-8eb3-5981fd9208f0" returned: 0 in 0.841s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] Lock "cinder-quobyte-4e916959-4f3e-48cf-8eb3-5981fd9208f0" released by "_delete_snapshot" :: held 4.028s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:10:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] Lock "cinder-quobyte-583dbf51-d23c-44af-b0c0-96856263e9f6" released by "delete_snapshot" :: held 4.054s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:10:18 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] Created reservations ['c6920d99-9d7b-43b3-a82c-cba28eea1b91', '41c3e5a7-ee6e-4491-9fbc-854a93350402', '76cb4ceb-6efa-4a87-913a-791afb3e9beb', 'aba03dda-48af-46e6-8a04-5874afdc7a43'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:10:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] Delete snapshot completed successfully. Jul 09 10:10:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d64dbce-f95b-430b-89e3-6cba31bbbbb0 tempest-SnapshotMetadataTestJSON-1913378401 None] Lock "cinder-4e916959-4f3e-48cf-8eb3-5981fd9208f0-delete_snapshot" released by "delete_snapshot" :: held 4.240s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:10:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-02ae7da8-fd74-45fe-a39e-9c5b25425d7c tempest-GroupsTest-5514105 None] Update group completed successfully. Jul 09 10:10:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-184e8d9d-92d1-4ff5-9e5b-2a710ea062d2 tempest-SnapshotMetadataTestJSON-1913378401 None] Acquiring lock "cinder-583dbf51-d23c-44af-b0c0-96856263e9f6-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-184e8d9d-92d1-4ff5-9e5b-2a710ea062d2 tempest-SnapshotMetadataTestJSON-1913378401 None] Lock "cinder-583dbf51-d23c-44af-b0c0-96856263e9f6-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-184e8d9d-92d1-4ff5-9e5b-2a710ea062d2 tempest-SnapshotMetadataTestJSON-1913378401 None] Acquiring lock "cinder-quobyte-583dbf51-d23c-44af-b0c0-96856263e9f6" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-184e8d9d-92d1-4ff5-9e5b-2a710ea062d2 tempest-SnapshotMetadataTestJSON-1913378401 None] Lock "cinder-quobyte-583dbf51-d23c-44af-b0c0-96856263e9f6" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:19 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc2aa96-d12e-4e4f-aea9-bb48a022095a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-184e8d9d-92d1-4ff5-9e5b-2a710ea062d2 tempest-SnapshotMetadataTestJSON-1913378401 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:19 devstack sudo[99226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6 Jul 09 10:10:19 devstack sudo[99226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b7e287e2-0c56-4082-90cd-5a03d59b8f99 tempest-GroupsTest-5514105 None] Update group completed successfully. Jul 09 10:10:20 devstack sudo[99226]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-184e8d9d-92d1-4ff5-9e5b-2a710ea062d2 tempest-SnapshotMetadataTestJSON-1913378401 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6" returned: 0 in 0.958s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-184e8d9d-92d1-4ff5-9e5b-2a710ea062d2 tempest-SnapshotMetadataTestJSON-1913378401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:20 devstack sudo[99231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6 Jul 09 10:10:20 devstack sudo[99231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:21 devstack sudo[99231]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-184e8d9d-92d1-4ff5-9e5b-2a710ea062d2 tempest-SnapshotMetadataTestJSON-1913378401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-583dbf51-d23c-44af-b0c0-96856263e9f6" returned: 0 in 0.785s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-184e8d9d-92d1-4ff5-9e5b-2a710ea062d2 tempest-SnapshotMetadataTestJSON-1913378401 None] Lock "cinder-quobyte-583dbf51-d23c-44af-b0c0-96856263e9f6" released by "delete_volume" :: held 1.810s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:10:21 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-184e8d9d-92d1-4ff5-9e5b-2a710ea062d2 tempest-SnapshotMetadataTestJSON-1913378401 None] Created reservations ['ec6d436f-779e-4ec8-9a1e-c092f2c9c6fc', 'bedad153-1877-4c4e-bae4-a2da42eb4121', '4f7cace5-e686-464e-92b1-3116d57fe11c', '0a649d33-6934-49dd-8a09-b0990a5d0060'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:10:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-184e8d9d-92d1-4ff5-9e5b-2a710ea062d2 tempest-SnapshotMetadataTestJSON-1913378401 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-184e8d9d-92d1-4ff5-9e5b-2a710ea062d2 tempest-SnapshotMetadataTestJSON-1913378401 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-184e8d9d-92d1-4ff5-9e5b-2a710ea062d2 tempest-SnapshotMetadataTestJSON-1913378401 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:10:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-184e8d9d-92d1-4ff5-9e5b-2a710ea062d2 tempest-SnapshotMetadataTestJSON-1913378401 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:10:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-184e8d9d-92d1-4ff5-9e5b-2a710ea062d2 tempest-SnapshotMetadataTestJSON-1913378401 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-184e8d9d-92d1-4ff5-9e5b-2a710ea062d2 tempest-SnapshotMetadataTestJSON-1913378401 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:21 devstack sudo[99234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:10:21 devstack sudo[99234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Acquiring lock "cinder-quobyte-7607565a-c041-4acf-9462-2851034ab89c" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Lock "cinder-quobyte-7607565a-c041-4acf-9462-2851034ab89c" acquired by "delete_volume" :: waited 0.036s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[85d82bb0-2ca8-4292-b570-8a49e5a8507e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7607565a-c041-4acf-9462-2851034ab89c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:22 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7607565a-c041-4acf-9462-2851034ab89c Jul 09 10:10:22 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:22 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-f98c4529-5ad2-44a5-b3c7-686e68ffad18 req-e3da7cc3-dacf-48ba-ab21-250289879c1c tempest-TestServerVolumeAttachmentScenario-1971854153 None] Terminate volume connection completed successfully. Jul 09 10:10:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-f98c4529-5ad2-44a5-b3c7-686e68ffad18 req-e3da7cc3-dacf-48ba-ab21-250289879c1c tempest-TestServerVolumeAttachmentScenario-1971854153 None] Deleting attachment 0a64b490-dc76-4820-a06b-9c2142db3ac7. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:10:22 devstack sudo[99234]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-184e8d9d-92d1-4ff5-9e5b-2a710ea062d2 tempest-SnapshotMetadataTestJSON-1913378401 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.113s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:22 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-184e8d9d-92d1-4ff5-9e5b-2a710ea062d2 tempest-SnapshotMetadataTestJSON-1913378401 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:10:22 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-184e8d9d-92d1-4ff5-9e5b-2a710ea062d2 tempest-SnapshotMetadataTestJSON-1913378401 None] Deleted volume successfully. Jul 09 10:10:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-184e8d9d-92d1-4ff5-9e5b-2a710ea062d2 tempest-SnapshotMetadataTestJSON-1913378401 None] Lock "cinder-583dbf51-d23c-44af-b0c0-96856263e9f6-delete_volume" released by "delete_volume" :: held 3.235s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:10:23 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7607565a-c041-4acf-9462-2851034ab89c" returned: 0 in 1.423s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7607565a-c041-4acf-9462-2851034ab89c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:24 devstack sudo[99244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7607565a-c041-4acf-9462-2851034ab89c Jul 09 10:10:24 devstack sudo[99244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:25 devstack sudo[99244]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7607565a-c041-4acf-9462-2851034ab89c" returned: 0 in 1.193s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Lock "cinder-quobyte-7607565a-c041-4acf-9462-2851034ab89c" released by "delete_volume" :: held 2.709s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:10:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Acquiring lock "cinder-quobyte-8be60a32-1b5b-49ab-a673-4b8ad582f94c" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Lock "cinder-quobyte-8be60a32-1b5b-49ab-a673-4b8ad582f94c" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:25 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c25671-0795-45e5-9df3-277626fda556]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8be60a32-1b5b-49ab-a673-4b8ad582f94c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:25 devstack sudo[99249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8be60a32-1b5b-49ab-a673-4b8ad582f94c Jul 09 10:10:25 devstack sudo[99249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:26 devstack sudo[99249]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8be60a32-1b5b-49ab-a673-4b8ad582f94c" returned: 0 in 1.123s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8be60a32-1b5b-49ab-a673-4b8ad582f94c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:26 devstack sudo[99254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8be60a32-1b5b-49ab-a673-4b8ad582f94c Jul 09 10:10:26 devstack sudo[99254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Flow 'volume_create_manager' (c5ee4a0b-16c6-46c6-bbd9-2299f579e2a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede28437-4af1-4005-8858-29627b7156a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ede28437-4af1-4005-8858-29627b7156a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2075945338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090bf041-76d2-4687-9b2f-66a58dd35814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5708199b424bf29bbf1cc6fdf8809b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:27Z,use_quota=True,user_id='e9a76e6455414c47ba4f84546263774f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7c9c1a-f86b-4555-b1e9-1c273c8298d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a7c9c1a-f86b-4555-b1e9-1c273c8298d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094046f2-684b-4066-b0cb-576a637f372e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (094046f2-684b-4066-b0cb-576a637f372e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '090bf041-76d2-4687-9b2f-66a58dd35814', 'volume_name': 'volume-090bf041-76d2-4687-9b2f-66a58dd35814', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d2beed-325c-479e-933c-ed03d8cfb823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d2beed-325c-479e-933c-ed03d8cfb823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a219a46b-90e7-4290-a0b8-f64c8c44ee6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:26 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Volume 090bf041-76d2-4687-9b2f-66a58dd35814: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-090bf041-76d2-4687-9b2f-66a58dd35814', 'volume_size': 1} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2075945338',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=090bf041-76d2-4687-9b2f-66a58dd35814,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5708199b424bf29bbf1cc6fdf8809b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:27Z,use_quota=True,user_id='e9a76e6455414c47ba4f84546263774f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Creating volume 090bf041-76d2-4687-9b2f-66a58dd35814 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:10:26 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:10:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:27 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814 1073741824 Jul 09 10:10:27 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:27 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-42615e70-2158-4c4c-915c-1f578027af36 req-0239d286-34b6-4a0a-8665-87009b649b72 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Terminate volume connection completed successfully. Jul 09 10:10:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-42615e70-2158-4c4c-915c-1f578027af36 req-0239d286-34b6-4a0a-8665-87009b649b72 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Deleting attachment 42c8f51c-82b3-4cba-93c2-a3f690966bed. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:10:27 devstack sudo[99254]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8be60a32-1b5b-49ab-a673-4b8ad582f94c" returned: 0 in 0.864s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Lock "cinder-quobyte-8be60a32-1b5b-49ab-a673-4b8ad582f94c" released by "delete_volume" :: held 2.042s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:10:27 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Created reservations ['735f369b-a86b-4aec-891a-21cf34664880'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:10:27 devstack cinder-volume[87192]: WARNING cinder.quota [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1459652698 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1459652698, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:10:27 devstack cinder-volume[87192]: WARNING cinder.quota [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1459652698 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1459652698, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:10:27 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Created reservations ['c412e6f8-7632-415c-9179-50387ebe17fe', '12893911-75c1-4a3b-9983-f258eb41857c', 'a859fe10-3b66-47d8-9997-ead87641f835', '76cb9e16-d258-4cc0-bcd4-a775a9871ab8'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:10:27 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Created reservations ['50325dba-2bae-4809-a0ec-53a871c99ee6', '1a32b65a-90b2-4388-b0fc-fb1d59ce2cc2', 'd41729d8-26b0-48d9-8ec1-cb4d6f98f2a3', '0c951a3e-8d7b-4f0c-9ac9-ead480c25e0f'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:10:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:10:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:10:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:27 devstack sudo[99262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:10:27 devstack sudo[99262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:28 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814 1073741824" returned: 0 in 1.215s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:28 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814 Jul 09 10:10:28 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:28 devstack sudo[99262]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.955s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:28 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:10:28 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-af5907a2-13ff-4650-9761-980e7dc4c064 tempest-GroupsTest-5514105 None] Delete group completed successfully. Jul 09 10:10:29 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814" returned: 0 in 0.820s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:10:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.109s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a219a46b-90e7-4290-a0b8-f64c8c44ee6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-090bf041-76d2-4687-9b2f-66a58dd35814', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb59d5f0-f821-490c-9a3a-d0a2774fadc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:29 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Volume volume-090bf041-76d2-4687-9b2f-66a58dd35814 (090bf041-76d2-4687-9b2f-66a58dd35814): created successfully Jul 09 10:10:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb59d5f0-f821-490c-9a3a-d0a2774fadc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Flow 'volume_create_manager' (c5ee4a0b-16c6-46c6-bbd9-2299f579e2a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:10:29 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1191c0fa-bd24-4215-b4bc-be53254118e0 tempest-VolumesDeleteCascade-1341916018 None] Created volume successfully. Jul 09 10:10:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:10:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:10:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:10:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:29 devstack sudo[99308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:10:29 devstack sudo[99308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-985e0691-e6ff-4a1e-8d27-775a3e48df0d tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-985e0691-e6ff-4a1e-8d27-775a3e48df0d tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-985e0691-e6ff-4a1e-8d27-775a3e48df0d tempest-VolumesDeleteCascade-1341916018 None] Creating offline snapshot 57314940-fa52-437d-bd17-acccf70a21c2 of volume 090bf041-76d2-4687-9b2f-66a58dd35814 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:10:30 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f47d07cf-4ecf-40b9-948a-c13a0876d0ed]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-985e0691-e6ff-4a1e-8d27-775a3e48df0d tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:30 devstack sudo[99328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814 Jul 09 10:10:30 devstack sudo[99328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:30 devstack sudo[99308]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.926s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:10:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:10:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:10:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:10:31 devstack sudo[99328]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-985e0691-e6ff-4a1e-8d27-775a3e48df0d tempest-VolumesDeleteCascade-1341916018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814" returned: 0 in 0.970s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-985e0691-e6ff-4a1e-8d27-775a3e48df0d tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:31 devstack sudo[99345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 1G Jul 09 10:10:31 devstack sudo[99345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:32 devstack sudo[99345]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-985e0691-e6ff-4a1e-8d27-775a3e48df0d tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 1G" returned: 0 in 1.203s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-985e0691-e6ff-4a1e-8d27-775a3e48df0d tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090bf041-76d2-4687-9b2f-66a58dd35814 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:32 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090bf041-76d2-4687-9b2f-66a58dd35814 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 Jul 09 10:10:32 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:33 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-985e0691-e6ff-4a1e-8d27-775a3e48df0d tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090bf041-76d2-4687-9b2f-66a58dd35814 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2" returned: 0 in 0.778s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:33 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-985e0691-e6ff-4a1e-8d27-775a3e48df0d tempest-VolumesDeleteCascade-1341916018 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 is being set with open permissions: ugo+rw Jul 09 10:10:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-985e0691-e6ff-4a1e-8d27-775a3e48df0d tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:33 devstack sudo[99370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 Jul 09 10:10:33 devstack sudo[99370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:33 devstack sudo[99370]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-985e0691-e6ff-4a1e-8d27-775a3e48df0d tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2" returned: 0 in 0.667s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-985e0691-e6ff-4a1e-8d27-775a3e48df0d tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:34 devstack sudo[99373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.info Jul 09 10:10:34 devstack sudo[99373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:34 devstack sudo[99373]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-985e0691-e6ff-4a1e-8d27-775a3e48df0d tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.info" returned: 0 in 0.680s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:34 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-985e0691-e6ff-4a1e-8d27-775a3e48df0d tempest-VolumesDeleteCascade-1341916018 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.info is being set with open permissions: ugo+rw Jul 09 10:10:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-985e0691-e6ff-4a1e-8d27-775a3e48df0d tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:34 devstack sudo[99376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.info Jul 09 10:10:34 devstack sudo[99376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:35 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a6b4b8c7-5971-4225-96b7-2889fbc66b3a tempest-GroupsV314Test-1298380024 None] Group tempest-GroupsV314Test-Group-1976455909: creating Jul 09 10:10:35 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a6b4b8c7-5971-4225-96b7-2889fbc66b3a tempest-GroupsV314Test-1298380024 None] Group tempest-GroupsV314Test-Group-1976455909: created successfully Jul 09 10:10:35 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a6b4b8c7-5971-4225-96b7-2889fbc66b3a tempest-GroupsV314Test-1298380024 None] Create group completed successfully. Jul 09 10:10:35 devstack sudo[99376]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-985e0691-e6ff-4a1e-8d27-775a3e48df0d tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.info" returned: 0 in 0.696s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-985e0691-e6ff-4a1e-8d27-775a3e48df0d tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.094s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:35 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-985e0691-e6ff-4a1e-8d27-775a3e48df0d tempest-VolumesDeleteCascade-1341916018 None] Create snapshot completed successfully Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Flow 'volume_create_manager' (343349ff-420e-4ba8-adf7-8cf36f6ec20f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d4e2f99-6a97-435c-90df-dc679b3117ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9d4e2f99-6a97-435c-90df-dc679b3117ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-88921455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=50b3fd79-6b49-4603-9635-74afc21041c0,host='devstack@QuobyteHD#QuobyteHD',id=800f8d14-ca24-4e3a-8954-8ea70acf60c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78ae771e62154c8db07ea7a50af47e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:37Z,use_quota=True,user_id='eda0ee18a4ca4b5f9dc28a5d9f3faa3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13b83e3c-9694-41e5-847a-dd6f4146783f),volume_type_id=13b83e3c-9694-41e5-847a-dd6f4146783f)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca60efc-a9f2-43c4-b05a-5ecb7a1f6205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3ca60efc-a9f2-43c4-b05a-5ecb7a1f6205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0180444f-0e4d-495e-9cb7-46d096edd424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0180444f-0e4d-495e-9cb7-46d096edd424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '800f8d14-ca24-4e3a-8954-8ea70acf60c4', 'volume_name': 'volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4bd4416-21cc-4af0-9929-18fc5a070a51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4bd4416-21cc-4af0-9929-18fc5a070a51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6242038c-5628-418f-9ced-0cd3663e23bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:36 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Volume 800f8d14-ca24-4e3a-8954-8ea70acf60c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4', 'volume_size': 1} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=50b3fd79-6b49-4603-9635-74afc21041c0,created_at=2026-07-09T08:10:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-88921455',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=50b3fd79-6b49-4603-9635-74afc21041c0,host='devstack@QuobyteHD#QuobyteHD',id=800f8d14-ca24-4e3a-8954-8ea70acf60c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78ae771e62154c8db07ea7a50af47e22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:37Z,use_quota=True,user_id='eda0ee18a4ca4b5f9dc28a5d9f3faa3d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(13b83e3c-9694-41e5-847a-dd6f4146783f),volume_type_id=13b83e3c-9694-41e5-847a-dd6f4146783f)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Creating volume 800f8d14-ca24-4e3a-8954-8ea70acf60c4 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:10:36 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d7b05c2d-f7a0-4fa4-b76b-42be6466c45c tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:36 devstack sudo[99380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 1073741824 Jul 09 10:10:36 devstack sudo[99380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:37 devstack sudo[99380]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 1073741824" returned: 0 in 1.068s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:38 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 Jul 09 10:10:38 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bf0e813d-6e17-422e-bd83-ecb3c5ac2f8d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Acquiring lock "cinder-84b69108-98eb-4162-b53b-9de5bb423074-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bf0e813d-6e17-422e-bd83-ecb3c5ac2f8d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "cinder-84b69108-98eb-4162-b53b-9de5bb423074-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bf0e813d-6e17-422e-bd83-ecb3c5ac2f8d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Acquiring lock "cinder-quobyte-84b69108-98eb-4162-b53b-9de5bb423074" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bf0e813d-6e17-422e-bd83-ecb3c5ac2f8d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "cinder-quobyte-84b69108-98eb-4162-b53b-9de5bb423074" acquired by "delete_volume" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3331ff-9612-4e18-a156-903b449f16aa]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bf0e813d-6e17-422e-bd83-ecb3c5ac2f8d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-84b69108-98eb-4162-b53b-9de5bb423074 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:38 devstack sudo[99398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-84b69108-98eb-4162-b53b-9de5bb423074 Jul 09 10:10:38 devstack sudo[99398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:38 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4" returned: 0 in 0.695s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:10:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d7b05c2d-f7a0-4fa4-b76b-42be6466c45c tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.790s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6242038c-5628-418f-9ced-0cd3663e23bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e3581f-7f39-4356-8532-445226bfbe30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d7b05c2d-f7a0-4fa4-b76b-42be6466c45c tempest-VolumesDeleteCascade-1341916018 None] Creating offline snapshot 6055f84c-102f-47a3-9d6b-c9d315743474 of volume 090bf041-76d2-4687-9b2f-66a58dd35814 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:10:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c96bd93-c660-4d4a-ba47-2a93aaaa3cdf]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7b05c2d-f7a0-4fa4-b76b-42be6466c45c tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:38 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Volume volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 (800f8d14-ca24-4e3a-8954-8ea70acf60c4): created successfully Jul 09 10:10:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31e3581f-7f39-4356-8532-445226bfbe30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Flow 'volume_create_manager' (343349ff-420e-4ba8-adf7-8cf36f6ec20f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:10:38 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-13777422-230b-4237-8aca-b79ea2304620 tempest-GroupsV314Test-1298380024 None] Created volume successfully. Jul 09 10:10:38 devstack sudo[99402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 Jul 09 10:10:38 devstack sudo[99402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:38 devstack sudo[99398]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bf0e813d-6e17-422e-bd83-ecb3c5ac2f8d tempest-TestServerVolumeAttachmentScenario-1971854153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-84b69108-98eb-4162-b53b-9de5bb423074" returned: 0 in 0.777s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bf0e813d-6e17-422e-bd83-ecb3c5ac2f8d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-84b69108-98eb-4162-b53b-9de5bb423074 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:39 devstack sudo[99406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-84b69108-98eb-4162-b53b-9de5bb423074 Jul 09 10:10:39 devstack sudo[99406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:39 devstack sudo[99402]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7b05c2d-f7a0-4fa4-b76b-42be6466c45c tempest-VolumesDeleteCascade-1341916018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2" returned: 0 in 0.808s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d7b05c2d-f7a0-4fa4-b76b-42be6466c45c tempest-VolumesDeleteCascade-1341916018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-090bf041-76d2-4687-9b2f-66a58dd35814(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:10:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7b05c2d-f7a0-4fa4-b76b-42be6466c45c tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:39 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474 1G Jul 09 10:10:39 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:39 devstack sudo[99406]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bf0e813d-6e17-422e-bd83-ecb3c5ac2f8d tempest-TestServerVolumeAttachmentScenario-1971854153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-84b69108-98eb-4162-b53b-9de5bb423074" returned: 0 in 0.703s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bf0e813d-6e17-422e-bd83-ecb3c5ac2f8d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "cinder-quobyte-84b69108-98eb-4162-b53b-9de5bb423074" released by "delete_volume" :: held 1.516s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:10:39 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-bf0e813d-6e17-422e-bd83-ecb3c5ac2f8d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Created reservations ['9b05ba40-22d4-485b-8e37-6047c489f1fe', 'a472899b-61a2-423b-afd7-ecd1eb7e641f', '4e6a58ef-5d22-4641-bb8e-3c545ae367f7', 'ed587115-d567-4083-9c05-9995427d6f25'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:10:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bf0e813d-6e17-422e-bd83-ecb3c5ac2f8d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bf0e813d-6e17-422e-bd83-ecb3c5ac2f8d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bf0e813d-6e17-422e-bd83-ecb3c5ac2f8d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:10:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bf0e813d-6e17-422e-bd83-ecb3c5ac2f8d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:10:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bf0e813d-6e17-422e-bd83-ecb3c5ac2f8d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bf0e813d-6e17-422e-bd83-ecb3c5ac2f8d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:39 devstack sudo[99414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:10:39 devstack sudo[99414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-64e1cf49-13a4-49dd-a540-f58e01d88232 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Acquiring lock "cinder-27c58790-b2b1-481e-953f-123890292b5c-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-64e1cf49-13a4-49dd-a540-f58e01d88232 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "cinder-27c58790-b2b1-481e-953f-123890292b5c-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-64e1cf49-13a4-49dd-a540-f58e01d88232 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Acquiring lock "cinder-quobyte-27c58790-b2b1-481e-953f-123890292b5c" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-64e1cf49-13a4-49dd-a540-f58e01d88232 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "cinder-quobyte-27c58790-b2b1-481e-953f-123890292b5c" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:40 devstack sudo[99414]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bf0e813d-6e17-422e-bd83-ecb3c5ac2f8d tempest-TestServerVolumeAttachmentScenario-1971854153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.799s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:40 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-bf0e813d-6e17-422e-bd83-ecb3c5ac2f8d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:10:40 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-bf0e813d-6e17-422e-bd83-ecb3c5ac2f8d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Deleted volume successfully. Jul 09 10:10:40 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8985c914-478c-4a2f-8bae-e3a532df52bd]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-64e1cf49-13a4-49dd-a540-f58e01d88232 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27c58790-b2b1-481e-953f-123890292b5c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bf0e813d-6e17-422e-bd83-ecb3c5ac2f8d tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "cinder-84b69108-98eb-4162-b53b-9de5bb423074-delete_volume" released by "delete_volume" :: held 2.529s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:10:40 devstack sudo[99420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27c58790-b2b1-481e-953f-123890292b5c Jul 09 10:10:40 devstack sudo[99420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:40 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7b05c2d-f7a0-4fa4-b76b-42be6466c45c tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474 1G" returned: 0 in 1.181s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7b05c2d-f7a0-4fa4-b76b-42be6466c45c tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:40 devstack sudo[99422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474 Jul 09 10:10:40 devstack sudo[99422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:41 devstack sudo[99420]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-64e1cf49-13a4-49dd-a540-f58e01d88232 tempest-TestServerVolumeAttachmentScenario-1971854153 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27c58790-b2b1-481e-953f-123890292b5c" returned: 0 in 0.935s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-64e1cf49-13a4-49dd-a540-f58e01d88232 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27c58790-b2b1-481e-953f-123890292b5c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:41 devstack sudo[99430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27c58790-b2b1-481e-953f-123890292b5c Jul 09 10:10:41 devstack sudo[99430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:41 devstack sudo[99422]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7b05c2d-f7a0-4fa4-b76b-42be6466c45c tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474" returned: 0 in 0.803s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:41 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-d7b05c2d-f7a0-4fa4-b76b-42be6466c45c tempest-VolumesDeleteCascade-1341916018 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474 is being set with open permissions: ugo+rw Jul 09 10:10:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7b05c2d-f7a0-4fa4-b76b-42be6466c45c tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:41 devstack sudo[99432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474 Jul 09 10:10:41 devstack sudo[99432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:42 devstack sudo[99430]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-64e1cf49-13a4-49dd-a540-f58e01d88232 tempest-TestServerVolumeAttachmentScenario-1971854153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-27c58790-b2b1-481e-953f-123890292b5c" returned: 0 in 0.653s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-64e1cf49-13a4-49dd-a540-f58e01d88232 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "cinder-quobyte-27c58790-b2b1-481e-953f-123890292b5c" released by "delete_volume" :: held 1.646s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:10:42 devstack sudo[99432]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7b05c2d-f7a0-4fa4-b76b-42be6466c45c tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474" returned: 0 in 0.656s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d7b05c2d-f7a0-4fa4-b76b-42be6466c45c tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.570s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:42 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-64e1cf49-13a4-49dd-a540-f58e01d88232 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Created reservations ['5cac87f7-4dc0-4501-b0cf-4f400ffa52c8', 'b5a9d901-6a2b-4b2e-bfb8-d8c3a523ec1a', 'fdf60e3e-1f10-437b-baf9-40a45b6bfcbd', '4cb11729-042d-4443-a49b-9e5612ee40f7'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:10:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.734s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:42 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Cloning volume 800f8d14-ca24-4e3a-8954-8ea70acf60c4 to volume 5eb45def-85dc-48a2-b9fd-5bfa3975f2f6 Jul 09 10:10:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d7b05c2d-f7a0-4fa4-b76b-42be6466c45c tempest-VolumesDeleteCascade-1341916018 None] Create snapshot completed successfully Jul 09 10:10:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Creating offline snapshot be90123d-2137-4e78-af85-6fa17695024b of volume 800f8d14-ca24-4e3a-8954-8ea70acf60c4 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:10:42 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5247455-3a6c-49c2-a4ff-b483281cb811]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-64e1cf49-13a4-49dd-a540-f58e01d88232 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-64e1cf49-13a4-49dd-a540-f58e01d88232 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-64e1cf49-13a4-49dd-a540-f58e01d88232 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:10:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-64e1cf49-13a4-49dd-a540-f58e01d88232 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:10:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-64e1cf49-13a4-49dd-a540-f58e01d88232 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-64e1cf49-13a4-49dd-a540-f58e01d88232 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:42 devstack sudo[99443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:10:42 devstack sudo[99443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:42 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 Jul 09 10:10:42 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:43 devstack sudo[99443]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-64e1cf49-13a4-49dd-a540-f58e01d88232 tempest-TestServerVolumeAttachmentScenario-1971854153 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.685s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:43 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-64e1cf49-13a4-49dd-a540-f58e01d88232 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:10:43 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-64e1cf49-13a4-49dd-a540-f58e01d88232 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Deleted volume successfully. Jul 09 10:10:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-64e1cf49-13a4-49dd-a540-f58e01d88232 tempest-TestServerVolumeAttachmentScenario-1971854153 None] Lock "cinder-27c58790-b2b1-481e-953f-123890292b5c-delete_volume" released by "delete_volume" :: held 2.689s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:10:43 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4" returned: 0 in 0.880s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "cinder-090bf041-76d2-4687-9b2f-66a58dd35814-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:43 devstack sudo[99450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b 1G Jul 09 10:10:43 devstack sudo[99450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-090bf041-76d2-4687-9b2f-66a58dd35814-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Performing cascade delete. {{(pid=87192) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 10:10:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "cinder-57314940-fa52-437d-bd17-acccf70a21c2-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-57314940-fa52-437d-bd17-acccf70a21c2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "cinder-quobyte-090bf041-76d2-4687-9b2f-66a58dd35814" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-090bf041-76d2-4687-9b2f-66a58dd35814" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "cinder-quobyte-57314940-fa52-437d-bd17-acccf70a21c2" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-57314940-fa52-437d-bd17-acccf70a21c2" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Deleting offline snapshot 57314940-fa52-437d-bd17-acccf70a21c2 of volume 090bf041-76d2-4687-9b2f-66a58dd35814 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:10:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] snapshot_file for this snap is: volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:10:43 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[61929003-c845-4a48-ae02-ea80045fe564]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:43 devstack sudo[99452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 Jul 09 10:10:43 devstack sudo[99452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:44 devstack sudo[99450]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b 1G" returned: 0 in 0.873s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:44 devstack sudo[99459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b Jul 09 10:10:44 devstack sudo[99459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:44 devstack sudo[99452]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2" returned: 0 in 0.863s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-090bf041-76d2-4687-9b2f-66a58dd35814(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:10:44 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a681ae-0041-4db0-8291-18e6ddd22f63]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:44 devstack sudo[99468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814 Jul 09 10:10:44 devstack sudo[99468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:45 devstack sudo[99459]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b" returned: 0 in 0.889s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:45 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b is being set with open permissions: ugo+rw: NotImplementedError Jul 09 10:10:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:45 devstack sudo[99477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b Jul 09 10:10:45 devstack sudo[99477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:45 devstack sudo[99468]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814" returned: 0 in 0.852s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:45 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[10f3cb00-39be-4254-a4e6-17856bb4263a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:45 devstack sudo[99482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474 Jul 09 10:10:45 devstack sudo[99482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:45 devstack sudo[99477]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b" returned: 0 in 0.793s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:45 devstack sudo[99485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.info Jul 09 10:10:45 devstack sudo[99485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:46 devstack sudo[99482]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474" returned: 0 in 1.012s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-090bf041-76d2-4687-9b2f-66a58dd35814(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:10:46 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f5f73d5-4aed-48ff-8f2a-3e6ca482e8a8]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:46 devstack sudo[99491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 Jul 09 10:10:46 devstack sudo[99491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:46 devstack sudo[99485]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.info" returned: 0 in 0.709s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:46 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.info is being set with open permissions: ugo+rw: NotImplementedError Jul 09 10:10:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:46 devstack sudo[99494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.info Jul 09 10:10:46 devstack sudo[99494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:47 devstack sudo[99494]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.info" returned: 0 in 0.760s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:47 devstack sudo[99491]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Acquiring lock "cinder-quobyte-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2" returned: 0 in 1.000s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-090bf041-76d2-4687-9b2f-66a58dd35814(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:10:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Lock "cinder-quobyte-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] snapshot: be90123d-2137-4e78-af85-6fa17695024b, volume: 5eb45def-85dc-48a2-b9fd-5bfa3975f2f6, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 10:10:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:10:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:10:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:47 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5aaa4bc-96b7-4902-807e-ea48e1eb61d3]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:47 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3911be1-8ac5-4564-9def-e58e9008838f]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:47 devstack sudo[99501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814 Jul 09 10:10:47 devstack sudo[99501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:47 devstack sudo[99502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b Jul 09 10:10:47 devstack sudo[99502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-209ba44a-f494-41e7-98ce-358122b65004 req-4c1b5751-46c3-450a-aa72-b449542e9cac tempest-TestStampPattern-1520710234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:48 devstack sudo[99501]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814" returned: 0 in 0.896s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:48 devstack sudo[99523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 Jul 09 10:10:48 devstack sudo[99523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:48 devstack sudo[99502]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b" returned: 0 in 0.972s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:10:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 10:10:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 10:10:48 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9f7fe61-4bb7-471c-af56-6fac562a1e6e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:48 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 Jul 09 10:10:48 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:49 devstack sudo[99523]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2" returned: 0 in 0.836s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:49 devstack sudo[99533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2 Jul 09 10:10:49 devstack sudo[99533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:49 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4" returned: 0 in 1.000s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:49 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Path /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6 not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 10:10:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:49 devstack sudo[99537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6 Jul 09 10:10:49 devstack sudo[99537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:49 devstack sudo[99533]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.57314940-fa52-437d-bd17-acccf70a21c2" returned: 0 in 0.758s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090bf041-76d2-4687-9b2f-66a58dd35814 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474 -F qcow2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:49 devstack sudo[99541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090bf041-76d2-4687-9b2f-66a58dd35814 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474 -F qcow2 Jul 09 10:10:49 devstack sudo[99541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:51 devstack sudo[99541]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-090bf041-76d2-4687-9b2f-66a58dd35814 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474 -F qcow2" returned: 0 in 1.464s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-57314940-fa52-437d-bd17-acccf70a21c2" released by "_delete_snapshot" :: held 8.007s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:10:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-090bf041-76d2-4687-9b2f-66a58dd35814" released by "delete_snapshot" :: held 8.052s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:10:51 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=108,cinder:UPDATE=93,cinder:DELETE=8,cinder:INSERT=23 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:10:51 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Created reservations ['7ee1c265-108b-4aca-94a1-7883e539e370', '745a424a-59a7-4005-b618-079883894261', 'ba572230-cd9d-480e-94ae-3c430912cc4e', 'e052f77c-6ad6-4f26-8fb9-54fa4a5239e5'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:10:51 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Delete snapshot completed successfully. Jul 09 10:10:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-57314940-fa52-437d-bd17-acccf70a21c2-delete_snapshot" released by "delete_snapshot" :: held 8.374s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:10:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "cinder-6055f84c-102f-47a3-9d6b-c9d315743474-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-6055f84c-102f-47a3-9d6b-c9d315743474-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "cinder-quobyte-090bf041-76d2-4687-9b2f-66a58dd35814" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-090bf041-76d2-4687-9b2f-66a58dd35814" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "cinder-quobyte-6055f84c-102f-47a3-9d6b-c9d315743474" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-6055f84c-102f-47a3-9d6b-c9d315743474" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Deleting offline snapshot 6055f84c-102f-47a3-9d6b-c9d315743474 of volume 090bf041-76d2-4687-9b2f-66a58dd35814 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:10:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] snapshot_file for this snap is: volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:10:52 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b79fb8-0530-4cef-9743-7d71b6bc8f3b]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:52 devstack sudo[99557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474 Jul 09 10:10:52 devstack sudo[99557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:54 devstack sudo[99557]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474" returned: 0 in 2.003s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-090bf041-76d2-4687-9b2f-66a58dd35814(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:10:54 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e7d4848-460f-4176-a66a-dd8a7fea79ef]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:54 devstack sudo[99563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814 Jul 09 10:10:54 devstack sudo[99563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:55 devstack sudo[99537]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6" returned: 0 in 5.842s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:55 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e09c98c9-bdc8-4a10-a2ee-c083380864b5]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:55 devstack sudo[99565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 Jul 09 10:10:55 devstack sudo[99565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:55 devstack sudo[99563]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814" returned: 0 in 1.576s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:55 devstack sudo[99570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474 Jul 09 10:10:55 devstack sudo[99570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:56 devstack sudo[99565]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4" returned: 0 in 0.915s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Image conversion details: src /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:10:56 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Converted 1024.00 MB image at 175.24 MB/s Jul 09 10:10:56 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6 is being set with open permissions: ugo+rw: NotImplementedError Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:56 devstack sudo[99575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6 Jul 09 10:10:56 devstack sudo[99575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:56 devstack sudo[99570]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474" returned: 0 in 0.784s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:56 devstack sudo[99580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474 Jul 09 10:10:56 devstack sudo[99580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Flow 'volume_create_manager' (45c4fe91-554a-49ac-abf9-065547091d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed887274-b311-4c02-b74f-9fa282413485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed887274-b311-4c02-b74f-9fa282413485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1274143213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e179f0-5289-45f3-8b4c-d0b09a5b0471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a028438f55471389a77865b0b33e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:57Z,use_quota=True,user_id='b254000dac404009839fb2d23cab725c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34cbc37c-9442-45a1-aa52-8ca36e21dcbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34cbc37c-9442-45a1-aa52-8ca36e21dcbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4affda-56a9-4a28-99d2-2bd45386a954) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd4affda-56a9-4a28-99d2-2bd45386a954) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9e179f0-5289-45f3-8b4c-d0b09a5b0471', 'volume_name': 'volume-f9e179f0-5289-45f3-8b4c-d0b09a5b0471', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d7a27d3-44f5-43eb-b1fb-a5d41863c179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d7a27d3-44f5-43eb-b1fb-a5d41863c179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f52188d-d58e-4730-937b-3c184e9d5716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:56 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Volume f9e179f0-5289-45f3-8b4c-d0b09a5b0471: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9e179f0-5289-45f3-8b4c-d0b09a5b0471', 'volume_size': 1} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:56 devstack sudo[99575]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6" returned: 0 in 0.687s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Lock "cinder-quobyte-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6" released by "_copy_volume_from_snapshot" :: held 9.522s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=105,cinder:UPDATE=108,cinder:INSERT=23,cinder:DELETE=5 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Acquiring lock "cinder-quobyte-be90123d-2137-4e78-af85-6fa17695024b" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Lock "cinder-quobyte-be90123d-2137-4e78-af85-6fa17695024b" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Deleting offline snapshot be90123d-2137-4e78-af85-6fa17695024b of volume 800f8d14-ca24-4e3a-8954-8ea70acf60c4 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] snapshot_file for this snap is: volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c92f3ad-48cc-4467-b97a-5a8c497cf5d9]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:57 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b Jul 09 10:10:57 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:57 devstack sudo[99580]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814.6055f84c-102f-47a3-9d6b-c9d315743474" returned: 0 in 0.720s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-6055f84c-102f-47a3-9d6b-c9d315743474" released by "_delete_snapshot" :: held 5.304s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-090bf041-76d2-4687-9b2f-66a58dd35814" released by "delete_snapshot" :: held 5.343s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Flow 'volume_create_manager' (92d45d3a-66e1-402b-b7cd-4151af5b65b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a416cc5f-dfac-4546-83ae-cc7413f7caf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a416cc5f-dfac-4546-83ae-cc7413f7caf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-242483954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0894a8-3ecc-4122-bae9-d84a1fffa807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a028438f55471389a77865b0b33e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:57Z,use_quota=True,user_id='b254000dac404009839fb2d23cab725c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4e39fc-bae4-46da-89ae-cc0fd89ec7b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c4e39fc-bae4-46da-89ae-cc0fd89ec7b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15031ba2-e00f-4d9c-a33c-54854bf08310) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15031ba2-e00f-4d9c-a33c-54854bf08310) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3d0894a8-3ecc-4122-bae9-d84a1fffa807', 'volume_name': 'volume-3d0894a8-3ecc-4122-bae9-d84a1fffa807', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4dff7d6-b66c-4a44-be8d-cd2d5e8299f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4dff7d6-b66c-4a44-be8d-cd2d5e8299f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56255864-5c9f-4937-b9c6-4916e1856245) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Volume 3d0894a8-3ecc-4122-bae9-d84a1fffa807: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3d0894a8-3ecc-4122-bae9-d84a1fffa807', 'volume_size': 1} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Created reservations ['1595f7fc-b31c-4504-a4a7-e2b3b19b3f46', '3aa0fd67-1d6e-4792-bda3-52d266b790fa', 'ba8cbead-3467-44a2-bc67-0d9541dfeeec', '600cbf30-65d5-4d2d-bb7f-95a74abf1e96'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:10:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Delete snapshot completed successfully. Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-6055f84c-102f-47a3-9d6b-c9d315743474-delete_snapshot" released by "delete_snapshot" :: held 5.674s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Snapshots deleted, issuing volume delete {{(pid=87192) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "cinder-quobyte-090bf041-76d2-4687-9b2f-66a58dd35814" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-090bf041-76d2-4687-9b2f-66a58dd35814" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e082d0a-d30f-4a43-8c35-23b2c22be2e2]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Flow 'volume_create_manager' (a8f945c6-06dd-4ae0-9df5-18c573d1a732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b43a6d4-a821-4a9b-8057-652abd86e568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b43a6d4-a821-4a9b-8057-652abd86e568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-792015358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790c79f2-07d8-4209-81aa-8ffd1d58ad72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a028438f55471389a77865b0b33e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:58Z,use_quota=True,user_id='b254000dac404009839fb2d23cab725c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411058c8-d1ba-4e6d-9676-982bc71fb4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:57 devstack sudo[99586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814 Jul 09 10:10:57 devstack sudo[99586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (411058c8-d1ba-4e6d-9676-982bc71fb4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9bb6a4-4095-40c2-a76c-9988f123d37f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc9bb6a4-4095-40c2-a76c-9988f123d37f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '790c79f2-07d8-4209-81aa-8ffd1d58ad72', 'volume_name': 'volume-790c79f2-07d8-4209-81aa-8ffd1d58ad72', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4035e799-d5f2-4b13-92bd-ae957428aa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4035e799-d5f2-4b13-92bd-ae957428aa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7de368-7c37-419f-b9ad-67529fed9825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Volume 790c79f2-07d8-4209-81aa-8ffd1d58ad72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-790c79f2-07d8-4209-81aa-8ffd1d58ad72', 'volume_size': 1} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:10:57 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Flow 'volume_create_manager' (88a561f6-9272-4fc0-a584-ae775b7d0733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be54518-168a-4489-b1e4-5d401675eee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b" returned: 0 in 1.032s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7be54518-168a-4489-b1e4-5d401675eee6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1926642463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93e5a27-b4ce-4173-a563-67990fe1fe20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a028438f55471389a77865b0b33e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:58Z,use_quota=True,user_id='b254000dac404009839fb2d23cab725c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (122cfe8f-d60e-433b-91f3-51320f58d5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (122cfe8f-d60e-433b-91f3-51320f58d5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8cd448-4017-40b1-b6f9-e98d6c9ac753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab8cd448-4017-40b1-b6f9-e98d6c9ac753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b93e5a27-b4ce-4173-a563-67990fe1fe20', 'volume_name': 'volume-b93e5a27-b4ce-4173-a563-67990fe1fe20', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5839fd66-e0d3-44df-aebb-02a76b797cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5839fd66-e0d3-44df-aebb-02a76b797cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae97403-2233-4010-b3c3-1856dd26b6d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:58 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Volume b93e5a27-b4ce-4173-a563-67990fe1fe20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b93e5a27-b4ce-4173-a563-67990fe1fe20', 'volume_size': 1} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adc2b94-8202-403a-9099-c26684d2e603]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:58 devstack sudo[99592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 Jul 09 10:10:58 devstack sudo[99592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:58 devstack sudo[99586]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814" returned: 0 in 0.901s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:58 devstack sudo[99597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814 Jul 09 10:10:58 devstack sudo[99597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Flow 'volume_create_manager' (5f9f64e1-63e3-4c7e-8423-6891883fe169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebeacedc-7aaa-4c13-a9fb-46138fa3e4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ebeacedc-7aaa-4c13-a9fb-46138fa3e4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1343289767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466d8201-7510-41d7-b0ab-8d3c3824f532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a028438f55471389a77865b0b33e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:58Z,use_quota=True,user_id='b254000dac404009839fb2d23cab725c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f4d981-9580-44ef-9297-26ecf1020494) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6f4d981-9580-44ef-9297-26ecf1020494) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c35c73b-e87e-41e3-baa5-6ab0807802a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7c35c73b-e87e-41e3-baa5-6ab0807802a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '466d8201-7510-41d7-b0ab-8d3c3824f532', 'volume_name': 'volume-466d8201-7510-41d7-b0ab-8d3c3824f532', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b88aed-2cf2-4ad6-8113-69ab9c0cba3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (57b88aed-2cf2-4ad6-8113-69ab9c0cba3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416816c3-6019-4db2-bd11-69812d29f4ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:10:58 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Volume 466d8201-7510-41d7-b0ab-8d3c3824f532: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-466d8201-7510-41d7-b0ab-8d3c3824f532', 'volume_size': 1} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:58 devstack sudo[99592]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4" returned: 0 in 0.844s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:58 devstack sudo[99602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b Jul 09 10:10:58 devstack sudo[99602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:59 devstack sudo[99597]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-090bf041-76d2-4687-9b2f-66a58dd35814" returned: 0 in 0.701s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-090bf041-76d2-4687-9b2f-66a58dd35814" released by "delete_volume" :: held 1.676s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:10:59 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Created reservations ['48dd8d0c-c4ea-47ca-ba92-fb15e612ad92', 'c258942d-36bd-4ae8-a050-8b3da5782b28', 'b5d87dc6-6b5c-4c18-80b1-b9b2b919b100', 'cef62d55-7cc6-4f2b-b576-7d30ffea0bbe'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:10:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:10:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:10:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:10:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:10:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:10:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:59 devstack sudo[99605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:10:59 devstack sudo[99605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:59 devstack sudo[99602]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b" returned: 0 in 0.777s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:10:59 devstack sudo[99610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b Jul 09 10:10:59 devstack sudo[99610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:10:59 devstack sudo[99605]: pam_unix(sudo:session): session closed for user root Jul 09 10:10:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.666s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:10:59 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:10:59 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Deleted volume successfully. Jul 09 10:10:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b131683-e623-4e2b-b163-da9b0b12c5f3 tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-090bf041-76d2-4687-9b2f-66a58dd35814-delete_volume" released by "delete_volume" :: held 16.693s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:00 devstack sudo[99610]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4.be90123d-2137-4e78-af85-6fa17695024b" returned: 0 in 0.672s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Lock "cinder-quobyte-be90123d-2137-4e78-af85-6fa17695024b" released by "_delete_snapshot" :: held 3.461s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 18.116s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-209ba44a-f494-41e7-98ce-358122b65004 req-4c1b5751-46c3-450a-aa72-b449542e9cac tempest-TestStampPattern-1520710234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.554s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:00 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c5cd62d-f33f-44fd-98bd-6e56d7523e68]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-209ba44a-f494-41e7-98ce-358122b65004 req-4c1b5751-46c3-450a-aa72-b449542e9cac tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2b8559fb-267d-4f4c-b50e-7f8147d461d3 tempest-GroupsV314Test-1298380024 None] Create group from source-group-50b3fd79-6b49-4603-9635-74afc21041c0 completed successfully. Jul 09 10:11:00 devstack sudo[99614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 Jul 09 10:11:00 devstack sudo[99614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Flow 'volume_create_manager' (65126f3f-b59a-4669-b2da-d2f42031099f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0765f3-e910-4e88-bbad-22079d2cbcf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba0765f3-e910-4e88-bbad-22079d2cbcf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1364278583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b54f98-bcee-48cb-83c8-df6b4ea505b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5708199b424bf29bbf1cc6fdf8809b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:11:01Z,use_quota=True,user_id='e9a76e6455414c47ba4f84546263774f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05f64aa-c9b7-4d1c-bf47-7d14419b6325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f05f64aa-c9b7-4d1c-bf47-7d14419b6325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b3aa7b1-7a6b-43c6-87b4-a31e2a887384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b3aa7b1-7a6b-43c6-87b4-a31e2a887384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13b54f98-bcee-48cb-83c8-df6b4ea505b8', 'volume_name': 'volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05929313-0300-4673-a2f2-37226fb51d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05929313-0300-4673-a2f2-37226fb51d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (415076b9-e10f-4ff5-8849-21efb4fe2095) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:01 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Volume 13b54f98-bcee-48cb-83c8-df6b4ea505b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8', 'volume_size': 1} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:01 devstack sudo[99614]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-209ba44a-f494-41e7-98ce-358122b65004 req-4c1b5751-46c3-450a-aa72-b449542e9cac tempest-TestStampPattern-1520710234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0" returned: 0 in 0.787s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-209ba44a-f494-41e7-98ce-358122b65004 req-4c1b5751-46c3-450a-aa72-b449542e9cac tempest-TestStampPattern-1520710234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.809s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.490s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:10:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1274143213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9e179f0-5289-45f3-8b4c-d0b09a5b0471,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a028438f55471389a77865b0b33e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:57Z,use_quota=True,user_id='b254000dac404009839fb2d23cab725c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Creating volume f9e179f0-5289-45f3-8b4c-d0b09a5b0471 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:11:01 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f9e179f0-5289-45f3-8b4c-d0b09a5b0471 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:01 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f9e179f0-5289-45f3-8b4c-d0b09a5b0471 1073741824 Jul 09 10:11:01 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-209ba44a-f494-41e7-98ce-358122b65004 req-4c1b5751-46c3-450a-aa72-b449542e9cac tempest-TestStampPattern-1520710234 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-e4d9b5a5-005a-470f-a250-a3efb99964b0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9d00b682-7d8c-431b-b723-9e3dd845e4af', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:11:01 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-209ba44a-f494-41e7-98ce-358122b65004 req-4c1b5751-46c3-450a-aa72-b449542e9cac tempest-TestStampPattern-1520710234 None] attachment_update completed successfully. Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8cac2c8b-a8ab-4d03-b7ab-db4deda89373 tempest-GroupsV314Test-1298380024 None] Acquiring lock "cinder-quobyte-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8cac2c8b-a8ab-4d03-b7ab-db4deda89373 tempest-GroupsV314Test-1298380024 None] Lock "cinder-quobyte-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70aa129-1565-49ad-8b07-1cb690ce0ad7]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cac2c8b-a8ab-4d03-b7ab-db4deda89373 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:02 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6 Jul 09 10:11:02 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:02 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f9e179f0-5289-45f3-8b4c-d0b09a5b0471 1073741824" returned: 0 in 0.923s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f9e179f0-5289-45f3-8b4c-d0b09a5b0471 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:02 devstack sudo[100010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f9e179f0-5289-45f3-8b4c-d0b09a5b0471 Jul 09 10:11:02 devstack sudo[100010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:02 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cac2c8b-a8ab-4d03-b7ab-db4deda89373 tempest-GroupsV314Test-1298380024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6" returned: 0 in 0.839s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cac2c8b-a8ab-4d03-b7ab-db4deda89373 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:02 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6 Jul 09 10:11:02 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:02 devstack sudo[100010]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f9e179f0-5289-45f3-8b4c-d0b09a5b0471" returned: 0 in 0.678s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] <== create_volume: return (1647ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:11:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.652s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.523s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-242483954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3d0894a8-3ecc-4122-bae9-d84a1fffa807,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a028438f55471389a77865b0b33e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:57Z,use_quota=True,user_id='b254000dac404009839fb2d23cab725c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:11:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Creating volume 3d0894a8-3ecc-4122-bae9-d84a1fffa807 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:11:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:11:02 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:11:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3d0894a8-3ecc-4122-bae9-d84a1fffa807 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:02 devstack sudo[100019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3d0894a8-3ecc-4122-bae9-d84a1fffa807 1073741824 Jul 09 10:11:02 devstack sudo[100019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f52188d-d58e-4730-937b-3c184e9d5716) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9e179f0-5289-45f3-8b4c-d0b09a5b0471', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246adeca-873c-4bbd-8d21-7633c4224ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:02 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Volume volume-f9e179f0-5289-45f3-8b4c-d0b09a5b0471 (f9e179f0-5289-45f3-8b4c-d0b09a5b0471): created successfully Jul 09 10:11:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (246adeca-873c-4bbd-8d21-7633c4224ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Flow 'volume_create_manager' (45c4fe91-554a-49ac-abf9-065547091d46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:11:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-dd0ea76a-e965-4850-8216-dfddef2b92f5 tempest-CreateVolumesFromImageTest-1965119881 None] Created volume successfully. Jul 09 10:11:03 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cac2c8b-a8ab-4d03-b7ab-db4deda89373 tempest-GroupsV314Test-1298380024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6" returned: 0 in 0.712s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8cac2c8b-a8ab-4d03-b7ab-db4deda89373 tempest-GroupsV314Test-1298380024 None] Lock "cinder-quobyte-5eb45def-85dc-48a2-b9fd-5bfa3975f2f6" released by "delete_volume" :: held 1.610s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:03 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-8cac2c8b-a8ab-4d03-b7ab-db4deda89373 tempest-GroupsV314Test-1298380024 None] Created reservations ['177cc9f6-fde8-41ae-80dc-17cfc6adad06'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:11:03 devstack cinder-volume[87192]: WARNING cinder.quota [None req-8cac2c8b-a8ab-4d03-b7ab-db4deda89373 tempest-GroupsV314Test-1298380024 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-676073282 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-676073282, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:11:03 devstack cinder-volume[87192]: WARNING cinder.quota [None req-8cac2c8b-a8ab-4d03-b7ab-db4deda89373 tempest-GroupsV314Test-1298380024 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-676073282 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-676073282, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:11:03 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-8cac2c8b-a8ab-4d03-b7ab-db4deda89373 tempest-GroupsV314Test-1298380024 None] Created reservations ['e2950073-6cf0-45c6-9436-7d92ddeda759', '6343fca7-047d-4d0d-bd8d-13320e606111', 'b5365262-ec50-4693-974e-dee4a7f6fd63', 'c852334f-f0dd-4dd1-9118-85039662c7fa'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:11:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8cac2c8b-a8ab-4d03-b7ab-db4deda89373 tempest-GroupsV314Test-1298380024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8cac2c8b-a8ab-4d03-b7ab-db4deda89373 tempest-GroupsV314Test-1298380024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8cac2c8b-a8ab-4d03-b7ab-db4deda89373 tempest-GroupsV314Test-1298380024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8cac2c8b-a8ab-4d03-b7ab-db4deda89373 tempest-GroupsV314Test-1298380024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8cac2c8b-a8ab-4d03-b7ab-db4deda89373 tempest-GroupsV314Test-1298380024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cac2c8b-a8ab-4d03-b7ab-db4deda89373 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:03 devstack sudo[100026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:11:03 devstack sudo[100026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:03 devstack sudo[100019]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3d0894a8-3ecc-4122-bae9-d84a1fffa807 1073741824" returned: 0 in 0.977s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3d0894a8-3ecc-4122-bae9-d84a1fffa807 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:03 devstack sudo[100028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3d0894a8-3ecc-4122-bae9-d84a1fffa807 Jul 09 10:11:03 devstack sudo[100028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:04 devstack sudo[100026]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8cac2c8b-a8ab-4d03-b7ab-db4deda89373 tempest-GroupsV314Test-1298380024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.707s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-8cac2c8b-a8ab-4d03-b7ab-db4deda89373 tempest-GroupsV314Test-1298380024 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:11:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8cac2c8b-a8ab-4d03-b7ab-db4deda89373 tempest-GroupsV314Test-1298380024 None] Delete group completed successfully. Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dbb8bd05-ab1c-459a-833d-6b663984a605 tempest-GroupsV314Test-1298380024 None] Acquiring lock "cinder-quobyte-800f8d14-ca24-4e3a-8954-8ea70acf60c4" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dbb8bd05-ab1c-459a-833d-6b663984a605 tempest-GroupsV314Test-1298380024 None] Lock "cinder-quobyte-800f8d14-ca24-4e3a-8954-8ea70acf60c4" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9508db17-8d08-4e1e-b63c-f42c269469c6]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dbb8bd05-ab1c-459a-833d-6b663984a605 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:04 devstack sudo[100028]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3d0894a8-3ecc-4122-bae9-d84a1fffa807" returned: 0 in 0.703s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] <== create_volume: return (1734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.912s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-792015358',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=790c79f2-07d8-4209-81aa-8ffd1d58ad72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a028438f55471389a77865b0b33e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:58Z,use_quota=True,user_id='b254000dac404009839fb2d23cab725c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Creating volume 790c79f2-07d8-4209-81aa-8ffd1d58ad72 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:04 devstack sudo[100032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 Jul 09 10:11:04 devstack sudo[100032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:11:04 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-790c79f2-07d8-4209-81aa-8ffd1d58ad72 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:04 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-790c79f2-07d8-4209-81aa-8ffd1d58ad72 1073741824 Jul 09 10:11:04 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56255864-5c9f-4937-b9c6-4916e1856245) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3d0894a8-3ecc-4122-bae9-d84a1fffa807', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f509926-d340-40df-a64f-68f5d1c282c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:04 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Volume volume-3d0894a8-3ecc-4122-bae9-d84a1fffa807 (3d0894a8-3ecc-4122-bae9-d84a1fffa807): created successfully Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f509926-d340-40df-a64f-68f5d1c282c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Flow 'volume_create_manager' (92d45d3a-66e1-402b-b7cd-4151af5b65b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:11:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7c408452-89b8-43d6-bb31-2ee7e1a7bba2 tempest-CreateVolumesFromImageTest-1965119881 None] Created volume successfully. Jul 09 10:11:05 devstack sudo[100032]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dbb8bd05-ab1c-459a-833d-6b663984a605 tempest-GroupsV314Test-1298380024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4" returned: 0 in 0.821s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dbb8bd05-ab1c-459a-833d-6b663984a605 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:05 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4 Jul 09 10:11:05 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:05 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-790c79f2-07d8-4209-81aa-8ffd1d58ad72 1073741824" returned: 0 in 0.878s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-790c79f2-07d8-4209-81aa-8ffd1d58ad72 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:05 devstack sudo[100046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-790c79f2-07d8-4209-81aa-8ffd1d58ad72 Jul 09 10:11:05 devstack sudo[100046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:06 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dbb8bd05-ab1c-459a-833d-6b663984a605 tempest-GroupsV314Test-1298380024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-800f8d14-ca24-4e3a-8954-8ea70acf60c4" returned: 0 in 0.695s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-dbb8bd05-ab1c-459a-833d-6b663984a605 tempest-GroupsV314Test-1298380024 None] Lock "cinder-quobyte-800f8d14-ca24-4e3a-8954-8ea70acf60c4" released by "delete_volume" :: held 1.584s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-dbb8bd05-ab1c-459a-833d-6b663984a605 tempest-GroupsV314Test-1298380024 None] Created reservations ['8001551e-69b5-49f8-8c8c-88e0375eed80'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-dbb8bd05-ab1c-459a-833d-6b663984a605 tempest-GroupsV314Test-1298380024 None] Created reservations ['b867c8e5-7792-445b-812d-79cdcbb72131', '1c708e73-db94-456f-823a-577bfa7b99ee', 'ac31c22a-906f-42fa-b0c8-450e16784eec', 'd448eee9-7ce1-4d33-84d7-dde8a4a1a461'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:11:06 devstack sudo[100046]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-790c79f2-07d8-4209-81aa-8ffd1d58ad72" returned: 0 in 0.727s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] <== create_volume: return (1651ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.229s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1926642463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b93e5a27-b4ce-4173-a563-67990fe1fe20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a028438f55471389a77865b0b33e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:58Z,use_quota=True,user_id='b254000dac404009839fb2d23cab725c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Creating volume b93e5a27-b4ce-4173-a563-67990fe1fe20 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:11:06 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b93e5a27-b4ce-4173-a563-67990fe1fe20 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4b7de368-7c37-419f-b9ad-67529fed9825) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-790c79f2-07d8-4209-81aa-8ffd1d58ad72', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6d081a-ebe8-45fb-9b97-b3ff89185c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:06 devstack sudo[100060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b93e5a27-b4ce-4173-a563-67990fe1fe20 1073741824 Jul 09 10:11:06 devstack sudo[100060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:06 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Volume volume-790c79f2-07d8-4209-81aa-8ffd1d58ad72 (790c79f2-07d8-4209-81aa-8ffd1d58ad72): created successfully Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b6d081a-ebe8-45fb-9b97-b3ff89185c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Flow 'volume_create_manager' (a8f945c6-06dd-4ae0-9df5-18c573d1a732) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dbb8bd05-ab1c-459a-833d-6b663984a605 tempest-GroupsV314Test-1298380024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dbb8bd05-ab1c-459a-833d-6b663984a605 tempest-GroupsV314Test-1298380024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dbb8bd05-ab1c-459a-833d-6b663984a605 tempest-GroupsV314Test-1298380024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-dbb8bd05-ab1c-459a-833d-6b663984a605 tempest-GroupsV314Test-1298380024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dbb8bd05-ab1c-459a-833d-6b663984a605 tempest-GroupsV314Test-1298380024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dbb8bd05-ab1c-459a-833d-6b663984a605 tempest-GroupsV314Test-1298380024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ef3c58f5-336b-4779-8921-437f929b11df tempest-CreateVolumesFromImageTest-1965119881 None] Created volume successfully. Jul 09 10:11:06 devstack sudo[100062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:11:06 devstack sudo[100062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:07 devstack sudo[100062]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dbb8bd05-ab1c-459a-833d-6b663984a605 tempest-GroupsV314Test-1298380024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.787s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:07 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-dbb8bd05-ab1c-459a-833d-6b663984a605 tempest-GroupsV314Test-1298380024 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:11:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-dbb8bd05-ab1c-459a-833d-6b663984a605 tempest-GroupsV314Test-1298380024 None] Delete group completed successfully. Jul 09 10:11:07 devstack sudo[100060]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b93e5a27-b4ce-4173-a563-67990fe1fe20 1073741824" returned: 0 in 0.983s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b93e5a27-b4ce-4173-a563-67990fe1fe20 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:07 devstack sudo[100069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b93e5a27-b4ce-4173-a563-67990fe1fe20 Jul 09 10:11:07 devstack sudo[100069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:08 devstack sudo[100069]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b93e5a27-b4ce-4173-a563-67990fe1fe20" returned: 0 in 0.689s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] <== create_volume: return (1731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:11:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.735s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.424s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1343289767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=466d8201-7510-41d7-b0ab-8d3c3824f532,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05a028438f55471389a77865b0b33e48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:10:58Z,use_quota=True,user_id='b254000dac404009839fb2d23cab725c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:11:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Creating volume 466d8201-7510-41d7-b0ab-8d3c3824f532 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:11:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:11:08 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:11:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-466d8201-7510-41d7-b0ab-8d3c3824f532 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:08 devstack sudo[100075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-466d8201-7510-41d7-b0ab-8d3c3824f532 1073741824 Jul 09 10:11:08 devstack sudo[100075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ae97403-2233-4010-b3c3-1856dd26b6d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b93e5a27-b4ce-4173-a563-67990fe1fe20', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdeffd0a-c810-4a9a-88fe-c4dabde21a39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Volume volume-b93e5a27-b4ce-4173-a563-67990fe1fe20 (b93e5a27-b4ce-4173-a563-67990fe1fe20): created successfully Jul 09 10:11:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdeffd0a-c810-4a9a-88fe-c4dabde21a39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Flow 'volume_create_manager' (88a561f6-9272-4fc0-a584-ae775b7d0733) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:11:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-67e30193-62af-4e6b-9a0d-880adb8c8c95 tempest-CreateVolumesFromImageTest-1965119881 None] Created volume successfully. Jul 09 10:11:09 devstack sudo[100075]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-466d8201-7510-41d7-b0ab-8d3c3824f532 1073741824" returned: 0 in 1.084s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-466d8201-7510-41d7-b0ab-8d3c3824f532 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:09 devstack sudo[100091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-466d8201-7510-41d7-b0ab-8d3c3824f532 Jul 09 10:11:09 devstack sudo[100091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:09 devstack sudo[100091]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-466d8201-7510-41d7-b0ab-8d3c3824f532" returned: 0 in 0.675s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] <== create_volume: return (1804ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:11:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.760s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1364278583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13b54f98-bcee-48cb-83c8-df6b4ea505b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5708199b424bf29bbf1cc6fdf8809b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:11:01Z,use_quota=True,user_id='e9a76e6455414c47ba4f84546263774f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:11:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Creating volume 13b54f98-bcee-48cb-83c8-df6b4ea505b8 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:11:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:11:09 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:11:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:09 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 1073741824 Jul 09 10:11:09 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (416816c3-6019-4db2-bd11-69812d29f4ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-466d8201-7510-41d7-b0ab-8d3c3824f532', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b0d7da-77bc-4af5-9789-88ecf4dafde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:09 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Volume volume-466d8201-7510-41d7-b0ab-8d3c3824f532 (466d8201-7510-41d7-b0ab-8d3c3824f532): created successfully Jul 09 10:11:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b0d7da-77bc-4af5-9789-88ecf4dafde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Flow 'volume_create_manager' (5f9f64e1-63e3-4c7e-8423-6891883fe169) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:11:09 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-455c3b5f-4c12-4352-a98a-d8acf16bb89e tempest-CreateVolumesFromImageTest-1965119881 None] Created volume successfully. Jul 09 10:11:10 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-9be3884b-077d-4fae-834b-fb4690cd3ad8 req-2cd635a0-e314-4929-a983-ba207e74c621 tempest-TestStampPattern-1520710234 None] Terminate volume connection completed successfully. Jul 09 10:11:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-9be3884b-077d-4fae-834b-fb4690cd3ad8 req-2cd635a0-e314-4929-a983-ba207e74c621 tempest-TestStampPattern-1520710234 None] Deleting attachment 9d00b682-7d8c-431b-b723-9e3dd845e4af. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:11:10 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 1073741824" returned: 0 in 0.923s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:10 devstack sudo[100129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 Jul 09 10:11:10 devstack sudo[100129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3c12f225-05e5-44fc-81e8-71b403d38494 tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "cinder-466d8201-7510-41d7-b0ab-8d3c3824f532-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3c12f225-05e5-44fc-81e8-71b403d38494 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "cinder-466d8201-7510-41d7-b0ab-8d3c3824f532-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3c12f225-05e5-44fc-81e8-71b403d38494 tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "cinder-quobyte-466d8201-7510-41d7-b0ab-8d3c3824f532" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3c12f225-05e5-44fc-81e8-71b403d38494 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "cinder-quobyte-466d8201-7510-41d7-b0ab-8d3c3824f532" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:11 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[21693b13-132c-4343-b8b1-bfff09fddb0d]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3c12f225-05e5-44fc-81e8-71b403d38494 tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-466d8201-7510-41d7-b0ab-8d3c3824f532 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:11 devstack sudo[100131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-466d8201-7510-41d7-b0ab-8d3c3824f532 Jul 09 10:11:11 devstack sudo[100131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:11 devstack sudo[100129]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8" returned: 0 in 0.762s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] <== create_volume: return (1736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:11:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.739s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (415076b9-e10f-4ff5-8849-21efb4fe2095) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a135383-c057-4d30-b747-d6961de2aaff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:11 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Volume volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 (13b54f98-bcee-48cb-83c8-df6b4ea505b8): created successfully Jul 09 10:11:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a135383-c057-4d30-b747-d6961de2aaff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:11 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Flow 'volume_create_manager' (65126f3f-b59a-4669-b2da-d2f42031099f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:11:11 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-366133c7-7264-42f3-9f63-070c1b5457d0 tempest-VolumesDeleteCascade-1341916018 None] Created volume successfully. Jul 09 10:11:11 devstack sudo[100131]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3c12f225-05e5-44fc-81e8-71b403d38494 tempest-CreateVolumesFromImageTest-1965119881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-466d8201-7510-41d7-b0ab-8d3c3824f532" returned: 0 in 0.857s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3c12f225-05e5-44fc-81e8-71b403d38494 tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-466d8201-7510-41d7-b0ab-8d3c3824f532 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:11 devstack sudo[100138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-466d8201-7510-41d7-b0ab-8d3c3824f532 Jul 09 10:11:11 devstack sudo[100138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:12 devstack sudo[100138]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3c12f225-05e5-44fc-81e8-71b403d38494 tempest-CreateVolumesFromImageTest-1965119881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-466d8201-7510-41d7-b0ab-8d3c3824f532" returned: 0 in 0.706s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3c12f225-05e5-44fc-81e8-71b403d38494 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "cinder-quobyte-466d8201-7510-41d7-b0ab-8d3c3824f532" released by "delete_volume" :: held 1.618s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0f4e70d4-ef56-4eb8-91cf-ce0fcd3bae0f tempest-TestStampPattern-1520710234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0f4e70d4-ef56-4eb8-91cf-ce0fcd3bae0f tempest-TestStampPattern-1520710234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0f4e70d4-ef56-4eb8-91cf-ce0fcd3bae0f tempest-TestStampPattern-1520710234 None] Creating offline snapshot ed245bc6-79c2-49e5-97a2-fed87f4ff1f0 of volume e4d9b5a5-005a-470f-a250-a3efb99964b0 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:11:12 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1c28813-b6ce-4c32-8d44-5d5ce2447437]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0f4e70d4-ef56-4eb8-91cf-ce0fcd3bae0f tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:12 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-3c12f225-05e5-44fc-81e8-71b403d38494 tempest-CreateVolumesFromImageTest-1965119881 None] Created reservations ['4ab7eea6-7c7e-4db0-ac51-8d4e99616f1e', 'cfd29995-8da3-4e0c-bb44-885a33fc3435', '8e8efad1-347a-4f60-944f-d8065e814f89', 'edc463d5-d6aa-42fa-a824-d307c46c3c93'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:11:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3c12f225-05e5-44fc-81e8-71b403d38494 tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3c12f225-05e5-44fc-81e8-71b403d38494 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3c12f225-05e5-44fc-81e8-71b403d38494 tempest-CreateVolumesFromImageTest-1965119881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3c12f225-05e5-44fc-81e8-71b403d38494 tempest-CreateVolumesFromImageTest-1965119881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3c12f225-05e5-44fc-81e8-71b403d38494 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3c12f225-05e5-44fc-81e8-71b403d38494 tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:12 devstack sudo[100141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 Jul 09 10:11:12 devstack sudo[100141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:12 devstack sudo[100142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:11:12 devstack sudo[100142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-160c0a58-819f-41b3-b75f-b3901b9475a4 tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef8ff880-e96c-4343-9a0f-422a7de3f96f tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "cinder-b93e5a27-b4ce-4173-a563-67990fe1fe20-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef8ff880-e96c-4343-9a0f-422a7de3f96f tempest-CreateVolumesFromImageTest-1965119881 None] Lock "cinder-b93e5a27-b4ce-4173-a563-67990fe1fe20-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef8ff880-e96c-4343-9a0f-422a7de3f96f tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "cinder-quobyte-b93e5a27-b4ce-4173-a563-67990fe1fe20" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef8ff880-e96c-4343-9a0f-422a7de3f96f tempest-CreateVolumesFromImageTest-1965119881 None] Lock "cinder-quobyte-b93e5a27-b4ce-4173-a563-67990fe1fe20" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:13 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff35edbd-83b6-4fe9-a34a-b8f7fd512fc5]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef8ff880-e96c-4343-9a0f-422a7de3f96f tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b93e5a27-b4ce-4173-a563-67990fe1fe20 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:13 devstack sudo[100145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b93e5a27-b4ce-4173-a563-67990fe1fe20 Jul 09 10:11:13 devstack sudo[100145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:13 devstack sudo[100142]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:13 devstack sudo[100141]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3c12f225-05e5-44fc-81e8-71b403d38494 tempest-CreateVolumesFromImageTest-1965119881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.758s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:13 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-3c12f225-05e5-44fc-81e8-71b403d38494 tempest-CreateVolumesFromImageTest-1965119881 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:11:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0f4e70d4-ef56-4eb8-91cf-ce0fcd3bae0f tempest-TestStampPattern-1520710234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0" returned: 0 in 0.858s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0f4e70d4-ef56-4eb8-91cf-ce0fcd3bae0f tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:13 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3c12f225-05e5-44fc-81e8-71b403d38494 tempest-CreateVolumesFromImageTest-1965119881 None] Deleted volume successfully. Jul 09 10:11:13 devstack sudo[100151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0 1G Jul 09 10:11:13 devstack sudo[100151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3c12f225-05e5-44fc-81e8-71b403d38494 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "cinder-466d8201-7510-41d7-b0ab-8d3c3824f532-delete_volume" released by "delete_volume" :: held 2.677s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:14 devstack sudo[100145]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef8ff880-e96c-4343-9a0f-422a7de3f96f tempest-CreateVolumesFromImageTest-1965119881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b93e5a27-b4ce-4173-a563-67990fe1fe20" returned: 0 in 0.838s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef8ff880-e96c-4343-9a0f-422a7de3f96f tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b93e5a27-b4ce-4173-a563-67990fe1fe20 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:14 devstack sudo[100157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b93e5a27-b4ce-4173-a563-67990fe1fe20 Jul 09 10:11:14 devstack sudo[100157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:14 devstack sudo[100151]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0f4e70d4-ef56-4eb8-91cf-ce0fcd3bae0f tempest-TestStampPattern-1520710234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0 1G" returned: 0 in 0.936s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0f4e70d4-ef56-4eb8-91cf-ce0fcd3bae0f tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:14 devstack sudo[100162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0 Jul 09 10:11:14 devstack sudo[100162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:14 devstack sudo[100157]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef8ff880-e96c-4343-9a0f-422a7de3f96f tempest-CreateVolumesFromImageTest-1965119881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b93e5a27-b4ce-4173-a563-67990fe1fe20" returned: 0 in 0.724s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef8ff880-e96c-4343-9a0f-422a7de3f96f tempest-CreateVolumesFromImageTest-1965119881 None] Lock "cinder-quobyte-b93e5a27-b4ce-4173-a563-67990fe1fe20" released by "delete_volume" :: held 1.611s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:14 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ef8ff880-e96c-4343-9a0f-422a7de3f96f tempest-CreateVolumesFromImageTest-1965119881 None] Created reservations ['494ecc3f-e002-4f47-b18f-736ba9129317', '8747faed-a2fc-4e21-a591-634d9c61efaf', '1206924a-8665-464e-af4f-e5a31e5b068d', 'c24d435c-155a-47d1-9670-e7317b64795f'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:11:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef8ff880-e96c-4343-9a0f-422a7de3f96f tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef8ff880-e96c-4343-9a0f-422a7de3f96f tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ef8ff880-e96c-4343-9a0f-422a7de3f96f tempest-CreateVolumesFromImageTest-1965119881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ef8ff880-e96c-4343-9a0f-422a7de3f96f tempest-CreateVolumesFromImageTest-1965119881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef8ff880-e96c-4343-9a0f-422a7de3f96f tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef8ff880-e96c-4343-9a0f-422a7de3f96f tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:14 devstack sudo[100165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:11:14 devstack sudo[100165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:15 devstack sudo[100162]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0f4e70d4-ef56-4eb8-91cf-ce0fcd3bae0f tempest-TestStampPattern-1520710234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0" returned: 0 in 0.721s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:15 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-0f4e70d4-ef56-4eb8-91cf-ce0fcd3bae0f tempest-TestStampPattern-1520710234 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0 is being set with open permissions: ugo+rw Jul 09 10:11:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0f4e70d4-ef56-4eb8-91cf-ce0fcd3bae0f tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:15 devstack sudo[100171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0 Jul 09 10:11:15 devstack sudo[100171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c635cd60-35e9-406d-a7ee-f40fcd5ad3ae tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "cinder-790c79f2-07d8-4209-81aa-8ffd1d58ad72-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c635cd60-35e9-406d-a7ee-f40fcd5ad3ae tempest-CreateVolumesFromImageTest-1965119881 None] Lock "cinder-790c79f2-07d8-4209-81aa-8ffd1d58ad72-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c635cd60-35e9-406d-a7ee-f40fcd5ad3ae tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "cinder-quobyte-790c79f2-07d8-4209-81aa-8ffd1d58ad72" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c635cd60-35e9-406d-a7ee-f40fcd5ad3ae tempest-CreateVolumesFromImageTest-1965119881 None] Lock "cinder-quobyte-790c79f2-07d8-4209-81aa-8ffd1d58ad72" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:15 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1aee3ab-d45a-4d79-8ca2-acc16aeed99b]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c635cd60-35e9-406d-a7ee-f40fcd5ad3ae tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-790c79f2-07d8-4209-81aa-8ffd1d58ad72 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:15 devstack sudo[100165]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef8ff880-e96c-4343-9a0f-422a7de3f96f tempest-CreateVolumesFromImageTest-1965119881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.715s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:15 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-ef8ff880-e96c-4343-9a0f-422a7de3f96f tempest-CreateVolumesFromImageTest-1965119881 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:11:15 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ef8ff880-e96c-4343-9a0f-422a7de3f96f tempest-CreateVolumesFromImageTest-1965119881 None] Deleted volume successfully. Jul 09 10:11:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef8ff880-e96c-4343-9a0f-422a7de3f96f tempest-CreateVolumesFromImageTest-1965119881 None] Lock "cinder-b93e5a27-b4ce-4173-a563-67990fe1fe20-delete_volume" released by "delete_volume" :: held 2.545s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:15 devstack sudo[100174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-790c79f2-07d8-4209-81aa-8ffd1d58ad72 Jul 09 10:11:15 devstack sudo[100174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:15 devstack sudo[100171]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0f4e70d4-ef56-4eb8-91cf-ce0fcd3bae0f tempest-TestStampPattern-1520710234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0" returned: 0 in 0.703s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0f4e70d4-ef56-4eb8-91cf-ce0fcd3bae0f tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:16 devstack sudo[100177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.info Jul 09 10:11:16 devstack sudo[100177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:16 devstack sudo[100174]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c635cd60-35e9-406d-a7ee-f40fcd5ad3ae tempest-CreateVolumesFromImageTest-1965119881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-790c79f2-07d8-4209-81aa-8ffd1d58ad72" returned: 0 in 0.864s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c635cd60-35e9-406d-a7ee-f40fcd5ad3ae tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-790c79f2-07d8-4209-81aa-8ffd1d58ad72 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:16 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-790c79f2-07d8-4209-81aa-8ffd1d58ad72 Jul 09 10:11:16 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:16 devstack sudo[100177]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0f4e70d4-ef56-4eb8-91cf-ce0fcd3bae0f tempest-TestStampPattern-1520710234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.info" returned: 0 in 0.739s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:16 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-0f4e70d4-ef56-4eb8-91cf-ce0fcd3bae0f tempest-TestStampPattern-1520710234 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.info is being set with open permissions: ugo+rw Jul 09 10:11:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0f4e70d4-ef56-4eb8-91cf-ce0fcd3bae0f tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:16 devstack sudo[100185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.info Jul 09 10:11:16 devstack sudo[100185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:17 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c635cd60-35e9-406d-a7ee-f40fcd5ad3ae tempest-CreateVolumesFromImageTest-1965119881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-790c79f2-07d8-4209-81aa-8ffd1d58ad72" returned: 0 in 0.704s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c635cd60-35e9-406d-a7ee-f40fcd5ad3ae tempest-CreateVolumesFromImageTest-1965119881 None] Lock "cinder-quobyte-790c79f2-07d8-4209-81aa-8ffd1d58ad72" released by "delete_volume" :: held 1.629s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c635cd60-35e9-406d-a7ee-f40fcd5ad3ae tempest-CreateVolumesFromImageTest-1965119881 None] Created reservations ['64702d5e-013b-465e-8f11-f1da7a2dabf3', 'c53b2b04-e6c6-4efc-a486-a4ed0bb04e0a', '32cf83d6-6e11-46bc-81cc-c42f9a3bcd3f', 'ec45ae84-e10a-4e7c-a16d-b1bd002dfb0d'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c635cd60-35e9-406d-a7ee-f40fcd5ad3ae tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c635cd60-35e9-406d-a7ee-f40fcd5ad3ae tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c635cd60-35e9-406d-a7ee-f40fcd5ad3ae tempest-CreateVolumesFromImageTest-1965119881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c635cd60-35e9-406d-a7ee-f40fcd5ad3ae tempest-CreateVolumesFromImageTest-1965119881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c635cd60-35e9-406d-a7ee-f40fcd5ad3ae tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c635cd60-35e9-406d-a7ee-f40fcd5ad3ae tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:17 devstack sudo[100189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:11:17 devstack sudo[100189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:17 devstack sudo[100185]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0f4e70d4-ef56-4eb8-91cf-ce0fcd3bae0f tempest-TestStampPattern-1520710234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.info" returned: 0 in 0.708s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0f4e70d4-ef56-4eb8-91cf-ce0fcd3bae0f tempest-TestStampPattern-1520710234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.771s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-160c0a58-819f-41b3-b75f-b3901b9475a4 tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.478s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-160c0a58-819f-41b3-b75f-b3901b9475a4 tempest-VolumesDeleteCascade-1341916018 None] Creating offline snapshot 85132f96-0858-459e-8d79-54cf74ce3912 of volume 13b54f98-bcee-48cb-83c8-df6b4ea505b8 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:11:17 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0f4e70d4-ef56-4eb8-91cf-ce0fcd3bae0f tempest-TestStampPattern-1520710234 None] Create snapshot completed successfully Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf0e240-1ba0-4329-9bd1-148b4f0d6544]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-160c0a58-819f-41b3-b75f-b3901b9475a4 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:17 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 Jul 09 10:11:17 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-96d6960b-6bbf-4222-9caa-7462c43bf860 tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "cinder-3d0894a8-3ecc-4122-bae9-d84a1fffa807-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-96d6960b-6bbf-4222-9caa-7462c43bf860 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "cinder-3d0894a8-3ecc-4122-bae9-d84a1fffa807-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-96d6960b-6bbf-4222-9caa-7462c43bf860 tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "cinder-quobyte-3d0894a8-3ecc-4122-bae9-d84a1fffa807" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-96d6960b-6bbf-4222-9caa-7462c43bf860 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "cinder-quobyte-3d0894a8-3ecc-4122-bae9-d84a1fffa807" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6dc9a8-b312-481d-a9d4-8f8a74eb5a2a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-96d6960b-6bbf-4222-9caa-7462c43bf860 tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3d0894a8-3ecc-4122-bae9-d84a1fffa807 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:18 devstack sudo[100194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3d0894a8-3ecc-4122-bae9-d84a1fffa807 Jul 09 10:11:18 devstack sudo[100194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:18 devstack sudo[100189]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c635cd60-35e9-406d-a7ee-f40fcd5ad3ae tempest-CreateVolumesFromImageTest-1965119881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.946s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:18 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-c635cd60-35e9-406d-a7ee-f40fcd5ad3ae tempest-CreateVolumesFromImageTest-1965119881 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:11:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c635cd60-35e9-406d-a7ee-f40fcd5ad3ae tempest-CreateVolumesFromImageTest-1965119881 None] Deleted volume successfully. Jul 09 10:11:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c635cd60-35e9-406d-a7ee-f40fcd5ad3ae tempest-CreateVolumesFromImageTest-1965119881 None] Lock "cinder-790c79f2-07d8-4209-81aa-8ffd1d58ad72-delete_volume" released by "delete_volume" :: held 2.849s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:18 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-160c0a58-819f-41b3-b75f-b3901b9475a4 tempest-VolumesDeleteCascade-1341916018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8" returned: 0 in 1.060s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-160c0a58-819f-41b3-b75f-b3901b9475a4 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:18 devstack sudo[100201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912 1G Jul 09 10:11:18 devstack sudo[100201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:18 devstack sudo[100194]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-96d6960b-6bbf-4222-9caa-7462c43bf860 tempest-CreateVolumesFromImageTest-1965119881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3d0894a8-3ecc-4122-bae9-d84a1fffa807" returned: 0 in 1.069s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-96d6960b-6bbf-4222-9caa-7462c43bf860 tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3d0894a8-3ecc-4122-bae9-d84a1fffa807 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:19 devstack sudo[100206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3d0894a8-3ecc-4122-bae9-d84a1fffa807 Jul 09 10:11:19 devstack sudo[100206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:19 devstack sudo[100201]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-160c0a58-819f-41b3-b75f-b3901b9475a4 tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912 1G" returned: 0 in 0.999s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-160c0a58-819f-41b3-b75f-b3901b9475a4 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:19 devstack sudo[100211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912 Jul 09 10:11:19 devstack sudo[100211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:19 devstack sudo[100206]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-96d6960b-6bbf-4222-9caa-7462c43bf860 tempest-CreateVolumesFromImageTest-1965119881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3d0894a8-3ecc-4122-bae9-d84a1fffa807" returned: 0 in 0.822s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-96d6960b-6bbf-4222-9caa-7462c43bf860 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "cinder-quobyte-3d0894a8-3ecc-4122-bae9-d84a1fffa807" released by "delete_volume" :: held 1.966s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:19 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-96d6960b-6bbf-4222-9caa-7462c43bf860 tempest-CreateVolumesFromImageTest-1965119881 None] Created reservations ['7ae37d4c-f76f-4e95-98cf-3ee42a58f1a8', 'a836af89-2b72-4b5d-8da0-9e9b45ffec07', 'cd59bcc8-a842-4121-9aa3-b2f03e4b42e9', '8d05068a-adff-439e-9507-7ad715765934'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:11:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-96d6960b-6bbf-4222-9caa-7462c43bf860 tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-96d6960b-6bbf-4222-9caa-7462c43bf860 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-96d6960b-6bbf-4222-9caa-7462c43bf860 tempest-CreateVolumesFromImageTest-1965119881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-96d6960b-6bbf-4222-9caa-7462c43bf860 tempest-CreateVolumesFromImageTest-1965119881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-96d6960b-6bbf-4222-9caa-7462c43bf860 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-96d6960b-6bbf-4222-9caa-7462c43bf860 tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:20 devstack sudo[100214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:11:20 devstack sudo[100214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b9629ab9-bd00-4041-bd0b-6cca335fa9fb tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "cinder-f9e179f0-5289-45f3-8b4c-d0b09a5b0471-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b9629ab9-bd00-4041-bd0b-6cca335fa9fb tempest-CreateVolumesFromImageTest-1965119881 None] Lock "cinder-f9e179f0-5289-45f3-8b4c-d0b09a5b0471-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b9629ab9-bd00-4041-bd0b-6cca335fa9fb tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "cinder-quobyte-f9e179f0-5289-45f3-8b4c-d0b09a5b0471" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b9629ab9-bd00-4041-bd0b-6cca335fa9fb tempest-CreateVolumesFromImageTest-1965119881 None] Lock "cinder-quobyte-f9e179f0-5289-45f3-8b4c-d0b09a5b0471" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:20 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7aa3e9-8dd4-4cc1-b418-d94a4421b859]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b9629ab9-bd00-4041-bd0b-6cca335fa9fb tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f9e179f0-5289-45f3-8b4c-d0b09a5b0471 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:20 devstack sudo[100216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f9e179f0-5289-45f3-8b4c-d0b09a5b0471 Jul 09 10:11:20 devstack sudo[100216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:20 devstack sudo[100211]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-160c0a58-819f-41b3-b75f-b3901b9475a4 tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912" returned: 0 in 0.922s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:20 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-160c0a58-819f-41b3-b75f-b3901b9475a4 tempest-VolumesDeleteCascade-1341916018 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912 is being set with open permissions: ugo+rw Jul 09 10:11:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-160c0a58-819f-41b3-b75f-b3901b9475a4 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:20 devstack sudo[100222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912 Jul 09 10:11:20 devstack sudo[100222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:20 devstack sudo[100214]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-96d6960b-6bbf-4222-9caa-7462c43bf860 tempest-CreateVolumesFromImageTest-1965119881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.770s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:20 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-96d6960b-6bbf-4222-9caa-7462c43bf860 tempest-CreateVolumesFromImageTest-1965119881 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:11:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-96d6960b-6bbf-4222-9caa-7462c43bf860 tempest-CreateVolumesFromImageTest-1965119881 None] Deleted volume successfully. Jul 09 10:11:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-96d6960b-6bbf-4222-9caa-7462c43bf860 tempest-CreateVolumesFromImageTest-1965119881 None] Lock "cinder-3d0894a8-3ecc-4122-bae9-d84a1fffa807-delete_volume" released by "delete_volume" :: held 3.063s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:21 devstack sudo[100216]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b9629ab9-bd00-4041-bd0b-6cca335fa9fb tempest-CreateVolumesFromImageTest-1965119881 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f9e179f0-5289-45f3-8b4c-d0b09a5b0471" returned: 0 in 0.957s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b9629ab9-bd00-4041-bd0b-6cca335fa9fb tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f9e179f0-5289-45f3-8b4c-d0b09a5b0471 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:21 devstack sudo[100229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f9e179f0-5289-45f3-8b4c-d0b09a5b0471 Jul 09 10:11:21 devstack sudo[100229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:21 devstack sudo[100222]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-160c0a58-819f-41b3-b75f-b3901b9475a4 tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912" returned: 0 in 0.749s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-160c0a58-819f-41b3-b75f-b3901b9475a4 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:21 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.info Jul 09 10:11:21 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:21 devstack sudo[100229]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b9629ab9-bd00-4041-bd0b-6cca335fa9fb tempest-CreateVolumesFromImageTest-1965119881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f9e179f0-5289-45f3-8b4c-d0b09a5b0471" returned: 0 in 0.702s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b9629ab9-bd00-4041-bd0b-6cca335fa9fb tempest-CreateVolumesFromImageTest-1965119881 None] Lock "cinder-quobyte-f9e179f0-5289-45f3-8b4c-d0b09a5b0471" released by "delete_volume" :: held 1.702s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:21 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-b9629ab9-bd00-4041-bd0b-6cca335fa9fb tempest-CreateVolumesFromImageTest-1965119881 None] Created reservations ['565dfaca-f158-41bc-a6a5-ac36ec878121', 'ecae1509-1063-4678-8ddb-a7002ef34e03', 'ea027d33-e3d0-49a7-b9b5-90b17a407d7a', 'e84b0a34-b6bb-4a5e-8612-9b8edaab33e5'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:11:21 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-160c0a58-819f-41b3-b75f-b3901b9475a4 tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.info" returned: 0 in 0.710s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:22 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-160c0a58-819f-41b3-b75f-b3901b9475a4 tempest-VolumesDeleteCascade-1341916018 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.info is being set with open permissions: ugo+rw Jul 09 10:11:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-160c0a58-819f-41b3-b75f-b3901b9475a4 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b9629ab9-bd00-4041-bd0b-6cca335fa9fb tempest-CreateVolumesFromImageTest-1965119881 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b9629ab9-bd00-4041-bd0b-6cca335fa9fb tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b9629ab9-bd00-4041-bd0b-6cca335fa9fb tempest-CreateVolumesFromImageTest-1965119881 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b9629ab9-bd00-4041-bd0b-6cca335fa9fb tempest-CreateVolumesFromImageTest-1965119881 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b9629ab9-bd00-4041-bd0b-6cca335fa9fb tempest-CreateVolumesFromImageTest-1965119881 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b9629ab9-bd00-4041-bd0b-6cca335fa9fb tempest-CreateVolumesFromImageTest-1965119881 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:22 devstack sudo[100235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.info Jul 09 10:11:22 devstack sudo[100235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:22 devstack sudo[100236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:11:22 devstack sudo[100236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:22 devstack sudo[100236]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b9629ab9-bd00-4041-bd0b-6cca335fa9fb tempest-CreateVolumesFromImageTest-1965119881 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.822s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:22 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-b9629ab9-bd00-4041-bd0b-6cca335fa9fb tempest-CreateVolumesFromImageTest-1965119881 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:11:22 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b9629ab9-bd00-4041-bd0b-6cca335fa9fb tempest-CreateVolumesFromImageTest-1965119881 None] Deleted volume successfully. Jul 09 10:11:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b9629ab9-bd00-4041-bd0b-6cca335fa9fb tempest-CreateVolumesFromImageTest-1965119881 None] Lock "cinder-f9e179f0-5289-45f3-8b4c-d0b09a5b0471-delete_volume" released by "delete_volume" :: held 2.818s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:22 devstack sudo[100235]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-160c0a58-819f-41b3-b75f-b3901b9475a4 tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.info" returned: 0 in 0.929s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-160c0a58-819f-41b3-b75f-b3901b9475a4 tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.506s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:22 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-160c0a58-819f-41b3-b75f-b3901b9475a4 tempest-VolumesDeleteCascade-1341916018 None] Create snapshot completed successfully Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Flow 'volume_create_manager' (b4bbeacb-b1ac-4ec5-9b23-3be2e5610f39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb1c92a-bf1d-4723-b480-15a843d62057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2fb1c92a-bf1d-4723-b480-15a843d62057) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:11:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1877190023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43c377e7-5a37-4dcc-8a0a-108292bfa86a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c5708199b424bf29bbf1cc6fdf8809b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=85132f96-0858-459e-8d79-54cf74ce3912,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:11:24Z,use_quota=True,user_id='e9a76e6455414c47ba4f84546263774f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8ede06-a256-4d18-a894-de10f962cc22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f8ede06-a256-4d18-a894-de10f962cc22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558bb734-5871-48ca-a799-0c13398e0c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (558bb734-5871-48ca-a799-0c13398e0c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '43c377e7-5a37-4dcc-8a0a-108292bfa86a', 'volume_name': 'volume-43c377e7-5a37-4dcc-8a0a-108292bfa86a', 'volume_size': 1, 'snapshot_id': '85132f96-0858-459e-8d79-54cf74ce3912'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97aea4b-8084-4a98-b50c-b77d29f95929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f97aea4b-8084-4a98-b50c-b77d29f95929) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23bba04-7543-4faa-a78f-d0a016337a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:24 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Volume 43c377e7-5a37-4dcc-8a0a-108292bfa86a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-43c377e7-5a37-4dcc-8a0a-108292bfa86a', 'volume_size': 1, 'snapshot_id': '85132f96-0858-459e-8d79-54cf74ce3912'} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "cinder-quobyte-85132f96-0858-459e-8d79-54cf74ce3912-43c377e7-5a37-4dcc-8a0a-108292bfa86a" by "_create_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-85132f96-0858-459e-8d79-54cf74ce3912-43c377e7-5a37-4dcc-8a0a-108292bfa86a" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Creating volume 43c377e7-5a37-4dcc-8a0a-108292bfa86a from snapshot 85132f96-0858-459e-8d79-54cf74ce3912 {{(pid=87192) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "cinder-quobyte-43c377e7-5a37-4dcc-8a0a-108292bfa86a" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-43c377e7-5a37-4dcc-8a0a-108292bfa86a" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] snapshot: 85132f96-0858-459e-8d79-54cf74ce3912, volume: 43c377e7-5a37-4dcc-8a0a-108292bfa86a, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[badd3f6b-2e57-4e6d-9ab7-7807baa1bd3c]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:24 devstack sudo[100281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912 Jul 09 10:11:24 devstack sudo[100281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:25 devstack sudo[100281]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912" returned: 0 in 0.960s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:11:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 10:11:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 10:11:25 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[19013c88-5e21-457a-8622-0d5f51252404]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:25 devstack sudo[100286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 Jul 09 10:11:25 devstack sudo[100286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:26 devstack sudo[100286]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8" returned: 0 in 0.789s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:26 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Path /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-43c377e7-5a37-4dcc-8a0a-108292bfa86a not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 10:11:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-43c377e7-5a37-4dcc-8a0a-108292bfa86a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:26 devstack sudo[100292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-43c377e7-5a37-4dcc-8a0a-108292bfa86a Jul 09 10:11:26 devstack sudo[100292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:11:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:29 devstack sudo[100340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:11:29 devstack sudo[100340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:31 devstack sudo[100340]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.341s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:31 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:11:31 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:11:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:11:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:11:32 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:11:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Flow 'volume_create_manager' (c80ea540-cf37-4505-b8e4-3dc8160cb2bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:11:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857fe8e8-f4e0-4af4-9035-abb6245d0667) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (857fe8e8-f4e0-4af4-9035-abb6245d0667) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:11:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1827559367',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e04905c-e7c5-4527-ace2-52e36d1e20c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b7ff3e3b37644b0949c14c4ae3799a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:11:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=ed245bc6-79c2-49e5-97a2-fed87f4ff1f0,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:11:32Z,use_quota=True,user_id='caf4810aee2b4b1faa1b27d1d81d39ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9c05cf-42a5-4e35-971f-f51631137f6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d9c05cf-42a5-4e35-971f-f51631137f6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7279fbf-70f2-4a8f-85e0-b696cc82e121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b7279fbf-70f2-4a8f-85e0-b696cc82e121) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '9e04905c-e7c5-4527-ace2-52e36d1e20c5', 'volume_name': 'volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5', 'volume_size': 1, 'snapshot_id': 'ed245bc6-79c2-49e5-97a2-fed87f4ff1f0'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b858302-ccda-4087-b167-335d1eec9f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b858302-ccda-4087-b167-335d1eec9f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:32 devstack sudo[100292]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec697b86-a70e-4fbd-b326-2b82d4558c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:32 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Volume 9e04905c-e7c5-4527-ace2-52e36d1e20c5: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5', 'volume_size': 1, 'snapshot_id': 'ed245bc6-79c2-49e5-97a2-fed87f4ff1f0'} Jul 09 10:11:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-43c377e7-5a37-4dcc-8a0a-108292bfa86a" returned: 0 in 6.411s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:32 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d457e93b-f4da-4999-b64e-5ae7ee610bc0]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:32 devstack sudo[100345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 Jul 09 10:11:32 devstack sudo[100345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:33 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:11:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Flow 'volume_create_manager' (84d47d28-15af-42b2-870e-87f804252e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:11:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762a9518-4485-45ed-85f1-d6fcd4a1701c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (762a9518-4485-45ed-85f1-d6fcd4a1701c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f97bc51-55f7-43aa-9901-c7c05a0ac5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e3b4d7f39c240f9b5948278efb69cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:11:33Z,use_quota=True,user_id='03c141c0c9c94257abb4194fbf747077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee0fc76-c1b1-4b5a-957d-2d620e7da0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eee0fc76-c1b1-4b5a-957d-2d620e7da0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c308ebcd-3295-43f6-b19f-35327af059be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:33 devstack cinder-volume[87192]: DEBUG cinder.image.glance [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Creating Keystone auth plugin from conf {{(pid=87192) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 10:11:33 devstack sudo[100345]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8" returned: 0 in 1.355s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Image conversion details: src /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8, size 1024.00 MB, duration 6.41 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-43c377e7-5a37-4dcc-8a0a-108292bfa86a {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:11:34 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Converted 1024.00 MB image at 159.66 MB/s Jul 09 10:11:34 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-43c377e7-5a37-4dcc-8a0a-108292bfa86a is being set with open permissions: ugo+rw Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-43c377e7-5a37-4dcc-8a0a-108292bfa86a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c308ebcd-3295-43f6-b19f-35327af059be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1f97bc51-55f7-43aa-9901-c7c05a0ac5f4', 'volume_name': 'volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4', 'volume_size': 1, 'image_id': 'c3c9a638-2118-4343-a9f2-7277d148cdec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3c9a638-2118-4343-a9f2-7277d148cdec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f33a1f0312409671efac5d4e810482c0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e3b4d7f39c240f9b5948278efb69cde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1d145384a57b9a6ac129898b71efb47af1d7e4ccafdec3ccb05460c0789301e15ee27f9b30cfa6550044835271610e6b5e8085823520f14fafa73fab52e1fafd', 'id': 'c3c9a638-2118-4343-a9f2-7277d148cdec', 'created_at': datetime.datetime(2026, 7, 9, 8, 11, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 8, 11, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3c9a638-2118-4343-a9f2-7277d148cdec/file', 'properties': {}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ca966f-fb0d-4372-996a-888ff4a1a5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:34 devstack sudo[100353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-43c377e7-5a37-4dcc-8a0a-108292bfa86a Jul 09 10:11:34 devstack sudo[100353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8ca966f-fb0d-4372-996a-888ff4a1a5d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b47b472-cbbe-44bb-8ed7-d71a477fda23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:34 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Volume 1f97bc51-55f7-43aa-9901-c7c05a0ac5f4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4', 'volume_size': 1, 'image_id': 'c3c9a638-2118-4343-a9f2-7277d148cdec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3c9a638-2118-4343-a9f2-7277d148cdec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f33a1f0312409671efac5d4e810482c0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e3b4d7f39c240f9b5948278efb69cde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1d145384a57b9a6ac129898b71efb47af1d7e4ccafdec3ccb05460c0789301e15ee27f9b30cfa6550044835271610e6b5e8085823520f14fafa73fab52e1fafd', 'id': 'c3c9a638-2118-4343-a9f2-7277d148cdec', 'created_at': datetime.datetime(2026, 7, 9, 8, 11, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 8, 11, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3c9a638-2118-4343-a9f2-7277d148cdec/file', 'properties': {}}, 'image_service': } Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Trying to clone 1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 from image c3c9a638-2118-4343-a9f2-7277d148cdec at location (None, [{'url': 'file:///opt/stack/data/glance/images/c3c9a638-2118-4343-a9f2-7277d148cdec', 'metadata': {}}]). {{(pid=87192) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 10:11:34 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Image download 0.00 MB at 0.00 MB/s Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e31ec7-6213-41ba-b632-e3d1f0ee86f2]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:34 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD Jul 09 10:11:34 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:34 devstack sudo[100353]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-43c377e7-5a37-4dcc-8a0a-108292bfa86a" returned: 0 in 0.943s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-43c377e7-5a37-4dcc-8a0a-108292bfa86a" released by "_copy_volume_from_snapshot" :: held 10.581s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-85132f96-0858-459e-8d79-54cf74ce3912-43c377e7-5a37-4dcc-8a0a-108292bfa86a" released by "_create_volume_from_snapshot" :: held 10.628s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.645s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.340s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Acquiring lock "cinder-quobyte-ed245bc6-79c2-49e5-97a2-fed87f4ff1f0-9e04905c-e7c5-4527-ace2-52e36d1e20c5" by "_create_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Lock "cinder-quobyte-ed245bc6-79c2-49e5-97a2-fed87f4ff1f0-9e04905c-e7c5-4527-ace2-52e36d1e20c5" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Creating volume 9e04905c-e7c5-4527-ace2-52e36d1e20c5 from snapshot ed245bc6-79c2-49e5-97a2-fed87f4ff1f0 {{(pid=87192) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Acquiring lock "cinder-quobyte-9e04905c-e7c5-4527-ace2-52e36d1e20c5" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23bba04-7543-4faa-a78f-d0a016337a6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43c377e7-5a37-4dcc-8a0a-108292bfa86a', 'volume_size': 1, 'snapshot_id': '85132f96-0858-459e-8d79-54cf74ce3912'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed1a132-73bf-4d4e-9f5e-85e0e67f5978) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Lock "cinder-quobyte-9e04905c-e7c5-4527-ace2-52e36d1e20c5" acquired by "_copy_volume_from_snapshot" :: waited 0.033s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] snapshot: ed245bc6-79c2-49e5-97a2-fed87f4ff1f0, volume: 9e04905c-e7c5-4527-ace2-52e36d1e20c5, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:35 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Volume volume-43c377e7-5a37-4dcc-8a0a-108292bfa86a (43c377e7-5a37-4dcc-8a0a-108292bfa86a): created successfully Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ed1a132-73bf-4d4e-9f5e-85e0e67f5978) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Flow 'volume_create_manager' (b4bbeacb-b1ac-4ec5-9b23-3be2e5610f39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7361919-db79-4475-b639-7e610af5725c]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:35 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-79a56bc4-a392-4bbd-b59d-06df59c211ac tempest-VolumesDeleteCascade-1341916018 None] Created volume successfully. Jul 09 10:11:35 devstack sudo[100359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0 Jul 09 10:11:35 devstack sudo[100359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:35 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD" returned: 0 in 1.041s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:35 devstack sudo[100362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD Jul 09 10:11:35 devstack sudo[100362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "cinder-13b54f98-bcee-48cb-83c8-df6b4ea505b8-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-13b54f98-bcee-48cb-83c8-df6b4ea505b8-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Performing cascade delete. {{(pid=87192) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "cinder-85132f96-0858-459e-8d79-54cf74ce3912-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-85132f96-0858-459e-8d79-54cf74ce3912-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "cinder-quobyte-13b54f98-bcee-48cb-83c8-df6b4ea505b8" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-13b54f98-bcee-48cb-83c8-df6b4ea505b8" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "cinder-quobyte-85132f96-0858-459e-8d79-54cf74ce3912" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-85132f96-0858-459e-8d79-54cf74ce3912" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Deleting offline snapshot 85132f96-0858-459e-8d79-54cf74ce3912 of volume 13b54f98-bcee-48cb-83c8-df6b4ea505b8 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:11:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] snapshot_file for this snap is: volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:11:36 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e612158-8fd1-4394-a4b0-7c0f182e3936]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:36 devstack sudo[100359]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0" returned: 0 in 1.073s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4d9b5a5-005a-470f-a250-a3efb99964b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:11:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 10:11:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 10:11:36 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0cf8adfe-f55d-43e9-af94-c815ea861e2a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:36 devstack sudo[100367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912 Jul 09 10:11:36 devstack sudo[100367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:36 devstack sudo[100362]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD" returned: 1 in 1.035s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:11:36 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Temporary image c3c9a638-2118-4343-a9f2-7277d148cdec is fetched for user 03c141c0c9c94257abb4194fbf747077. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 10:11:36 devstack sudo[100371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 Jul 09 10:11:36 devstack sudo[100371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:36 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[773bc2fb-a14a-4b0a-821f-90be87143905]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:36 devstack sudo[100374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD Jul 09 10:11:36 devstack sudo[100374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:37 devstack sudo[100367]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912" returned: 0 in 1.080s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:11:37 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9baa767d-15eb-428d-8f50-6c42ab36d861]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:37 devstack sudo[100371]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:37 devstack sudo[100374]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD" returned: 0 in 0.876s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0" returned: 0 in 1.096s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:37 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Path /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5 not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 10:11:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:37 devstack sudo[100385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 Jul 09 10:11:37 devstack sudo[100385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:37 devstack sudo[100387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5 Jul 09 10:11:37 devstack sudo[100387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:37 devstack sudo[100386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD Jul 09 10:11:37 devstack sudo[100386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:38 devstack sudo[100385]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8" returned: 0 in 0.951s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:38 devstack sudo[100386]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD" returned: 1 in 0.889s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:11:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:38 devstack sudo[100401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912 Jul 09 10:11:38 devstack sudo[100401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:39 devstack sudo[100401]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912" returned: 0 in 1.773s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:40 devstack sudo[100418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912 Jul 09 10:11:40 devstack sudo[100418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:40 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:11:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Flow 'volume_create_manager' (b2d62ce2-87a0-406c-a4e0-bc597a47440a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:11:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e04978-7941-46d6-9cf7-a4bfa07043f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73e04978-7941-46d6-9cf7-a4bfa07043f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-70799463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e617cc-83ee-4868-91a8-07405822472e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b359552a4e5849c1bfdb2259e31923e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:11:40Z,use_quota=True,user_id='9dcaea6b076d48579e5889b9586bc27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e51f1e16-a5a6-4215-a6ec-bbaf96928f49),volume_type_id=e51f1e16-a5a6-4215-a6ec-bbaf96928f49)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148081f1-014e-436b-83da-631b74d918f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148081f1-014e-436b-83da-631b74d918f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a9e825e-dcd4-4621-b760-8d989f184784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a9e825e-dcd4-4621-b760-8d989f184784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2e617cc-83ee-4868-91a8-07405822472e', 'volume_name': 'volume-a2e617cc-83ee-4868-91a8-07405822472e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa88c8e0-f16a-49c8-9f3b-f9ded7dbf5da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa88c8e0-f16a-49c8-9f3b-f9ded7dbf5da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3a3211-1bef-4b60-8181-285374b23c61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:40 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Volume a2e617cc-83ee-4868-91a8-07405822472e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2e617cc-83ee-4868-91a8-07405822472e', 'volume_size': 1} Jul 09 10:11:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:41 devstack sudo[100418]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8.85132f96-0858-459e-8d79-54cf74ce3912" returned: 0 in 1.413s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-85132f96-0858-459e-8d79-54cf74ce3912" released by "_delete_snapshot" :: held 5.420s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-13b54f98-bcee-48cb-83c8-df6b4ea505b8" released by "delete_snapshot" :: held 5.476s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:41 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Created reservations ['c921b0fd-74fb-4f17-ae01-ff0c5acefa2d', 'f753eccd-0d75-43ad-952e-c439268e58bc', 'cd94d3a5-b9a8-4241-b6f6-d992088844f9', '12d98e51-697b-448e-9e6a-8dfb03cc46ae'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:11:41 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Delete snapshot completed successfully. Jul 09 10:11:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-85132f96-0858-459e-8d79-54cf74ce3912-delete_snapshot" released by "delete_snapshot" :: held 5.980s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Snapshots deleted, issuing volume delete {{(pid=87192) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 09 10:11:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "cinder-quobyte-13b54f98-bcee-48cb-83c8-df6b4ea505b8" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-13b54f98-bcee-48cb-83c8-df6b4ea505b8" acquired by "delete_volume" :: waited 0.056s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:42 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6083fe7d-7134-4c27-95a7-28cd0cd0a788]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:42 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 Jul 09 10:11:42 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:43 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8" returned: 0 in 1.632s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:43 devstack sudo[100436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8 Jul 09 10:11:43 devstack sudo[100436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5" returned: 0 in 7.467s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:44 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d52a289-b3c1-4237-9200-7dea3a015986]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:44 devstack sudo[100438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 Jul 09 10:11:44 devstack sudo[100438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:45 devstack sudo[100436]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-13b54f98-bcee-48cb-83c8-df6b4ea505b8" returned: 0 in 1.273s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-13b54f98-bcee-48cb-83c8-df6b4ea505b8" released by "delete_volume" :: held 3.087s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:45 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Created reservations ['62fb94d4-87c3-423c-abca-2b7607ffdc37', '1721ccc3-3aa9-4908-a052-c04aaca34546', '77bc2e9f-ef3d-4dc7-b6c1-3ed64d8a3b75', '8502791a-211c-4253-b6c1-9d5fda2314e7'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:11:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:45 devstack sudo[100453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:11:45 devstack sudo[100453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:45 devstack sudo[100438]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0" returned: 0 in 1.163s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:45 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Image conversion details: src /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0, size 1024.00 MB, duration 7.47 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:11:45 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Converted 1024.00 MB image at 137.11 MB/s Jul 09 10:11:45 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5 is being set with open permissions: ugo+rw Jul 09 10:11:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:45 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5 Jul 09 10:11:45 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:46 devstack sudo[100453]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.847s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:11:46 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Deleted volume successfully. Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3f83e009-22e6-4d85-8eab-beb140dc256d tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-13b54f98-bcee-48cb-83c8-df6b4ea505b8-delete_volume" released by "delete_volume" :: held 10.290s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cf729671-a47f-4eea-a0f9-65c43d422be8 tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "cinder-43c377e7-5a37-4dcc-8a0a-108292bfa86a-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cf729671-a47f-4eea-a0f9-65c43d422be8 tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-43c377e7-5a37-4dcc-8a0a-108292bfa86a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cf729671-a47f-4eea-a0f9-65c43d422be8 tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "cinder-quobyte-43c377e7-5a37-4dcc-8a0a-108292bfa86a" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cf729671-a47f-4eea-a0f9-65c43d422be8 tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-43c377e7-5a37-4dcc-8a0a-108292bfa86a" acquired by "delete_volume" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[df885159-ee5a-4c3a-865b-9928a03db1b4]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cf729671-a47f-4eea-a0f9-65c43d422be8 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-43c377e7-5a37-4dcc-8a0a-108292bfa86a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:46 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-43c377e7-5a37-4dcc-8a0a-108292bfa86a Jul 09 10:11:46 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:46 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5" returned: 0 in 0.666s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Lock "cinder-quobyte-9e04905c-e7c5-4527-ace2-52e36d1e20c5" released by "_copy_volume_from_snapshot" :: held 11.600s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Lock "cinder-quobyte-ed245bc6-79c2-49e5-97a2-fed87f4ff1f0-9e04905c-e7c5-4527-ace2-52e36d1e20c5" released by "_create_volume_from_snapshot" :: held 11.653s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.676s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.466s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:11:33Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f97bc51-55f7-43aa-9901-c7c05a0ac5f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4e3b4d7f39c240f9b5948278efb69cde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:11:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:11:33Z,use_quota=True,user_id='03c141c0c9c94257abb4194fbf747077',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Creating volume 1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:11:46 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:46 devstack sudo[100481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 1073741824 Jul 09 10:11:46 devstack sudo[100481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ec697b86-a70e-4fbd-b326-2b82d4558c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5', 'volume_size': 1, 'snapshot_id': 'ed245bc6-79c2-49e5-97a2-fed87f4ff1f0'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0481a2ce-aae4-4bff-a0b1-97e408316270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:46 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Volume volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5 (9e04905c-e7c5-4527-ace2-52e36d1e20c5): created successfully Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0481a2ce-aae4-4bff-a0b1-97e408316270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:46 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Flow 'volume_create_manager' (c80ea540-cf37-4505-b8e4-3dc8160cb2bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:11:46 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b072cd8c-2f50-4949-8d0d-c10acfbf6847 tempest-TestStampPattern-1520710234 None] Created volume successfully. Jul 09 10:11:47 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cf729671-a47f-4eea-a0f9-65c43d422be8 tempest-VolumesDeleteCascade-1341916018 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-43c377e7-5a37-4dcc-8a0a-108292bfa86a" returned: 0 in 0.859s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cf729671-a47f-4eea-a0f9-65c43d422be8 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-43c377e7-5a37-4dcc-8a0a-108292bfa86a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:47 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-43c377e7-5a37-4dcc-8a0a-108292bfa86a Jul 09 10:11:47 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:47 devstack sudo[100481]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 1073741824" returned: 0 in 0.851s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:47 devstack sudo[100493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 Jul 09 10:11:47 devstack sudo[100493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:47 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cf729671-a47f-4eea-a0f9-65c43d422be8 tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-43c377e7-5a37-4dcc-8a0a-108292bfa86a" returned: 0 in 0.726s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cf729671-a47f-4eea-a0f9-65c43d422be8 tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-quobyte-43c377e7-5a37-4dcc-8a0a-108292bfa86a" released by "delete_volume" :: held 1.624s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:47 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-cf729671-a47f-4eea-a0f9-65c43d422be8 tempest-VolumesDeleteCascade-1341916018 None] Created reservations ['e480df15-8093-4425-b454-36b31ebab96e', '15686b7a-a640-4f87-8541-c94a7bf24f19', 'fb0fa845-0398-4883-bafe-2b1390ac5cba', 'ac7be31d-9486-4e5c-8169-d6a92b7f2998'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cf729671-a47f-4eea-a0f9-65c43d422be8 tempest-VolumesDeleteCascade-1341916018 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cf729671-a47f-4eea-a0f9-65c43d422be8 tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cf729671-a47f-4eea-a0f9-65c43d422be8 tempest-VolumesDeleteCascade-1341916018 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cf729671-a47f-4eea-a0f9-65c43d422be8 tempest-VolumesDeleteCascade-1341916018 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cf729671-a47f-4eea-a0f9-65c43d422be8 tempest-VolumesDeleteCascade-1341916018 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cf729671-a47f-4eea-a0f9-65c43d422be8 tempest-VolumesDeleteCascade-1341916018 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:48 devstack sudo[100497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:11:48 devstack sudo[100497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:48 devstack sudo[100493]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4" returned: 0 in 0.669s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] <== create_volume: return (1566ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.572s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.817s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:11:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-70799463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2e617cc-83ee-4868-91a8-07405822472e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b359552a4e5849c1bfdb2259e31923e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:11:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:11:40Z,use_quota=True,user_id='9dcaea6b076d48579e5889b9586bc27b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e51f1e16-a5a6-4215-a6ec-bbaf96928f49),volume_type_id=e51f1e16-a5a6-4215-a6ec-bbaf96928f49)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Creating volume a2e617cc-83ee-4868-91a8-07405822472e {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:11:48 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a2e617cc-83ee-4868-91a8-07405822472e 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:48 devstack sudo[100500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a2e617cc-83ee-4868-91a8-07405822472e 1073741824 Jul 09 10:11:48 devstack sudo[100500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Attempting download of c3c9a638-2118-4343-a9f2-7277d148cdec ((None, [{'url': 'file:///opt/stack/data/glance/images/c3c9a638-2118-4343-a9f2-7277d148cdec', 'metadata': {}}])) to volume 1f97bc51-55f7-43aa-9901-c7c05a0ac5f4. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[251aec01-77fe-426c-8e1d-7c604696f094]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3c9a638-2118-4343-a9f2-7277d148cdec_iri0ye3o {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:48 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3c9a638-2118-4343-a9f2-7277d148cdec_iri0ye3o Jul 09 10:11:48 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:49 devstack sudo[100497]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cf729671-a47f-4eea-a0f9-65c43d422be8 tempest-VolumesDeleteCascade-1341916018 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.218s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:49 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-cf729671-a47f-4eea-a0f9-65c43d422be8 tempest-VolumesDeleteCascade-1341916018 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:11:49 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-cf729671-a47f-4eea-a0f9-65c43d422be8 tempest-VolumesDeleteCascade-1341916018 None] Deleted volume successfully. Jul 09 10:11:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cf729671-a47f-4eea-a0f9-65c43d422be8 tempest-VolumesDeleteCascade-1341916018 None] Lock "cinder-43c377e7-5a37-4dcc-8a0a-108292bfa86a-delete_volume" released by "delete_volume" :: held 3.036s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:49 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_c3c9a638-2118-4343-a9f2-7277d148cdec_iri0ye3o" returned: 0 in 0.988s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3c9a638-2118-4343-a9f2-7277d148cdec_iri0ye3o {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:49 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3c9a638-2118-4343-a9f2-7277d148cdec_iri0ye3o Jul 09 10:11:49 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:49 devstack sudo[100500]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a2e617cc-83ee-4868-91a8-07405822472e 1073741824" returned: 0 in 1.384s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a2e617cc-83ee-4868-91a8-07405822472e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:49 devstack sudo[100534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a2e617cc-83ee-4868-91a8-07405822472e Jul 09 10:11:49 devstack sudo[100534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:50 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3c9a638-2118-4343-a9f2-7277d148cdec_iri0ye3o" returned: 1 in 0.945s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_c3c9a638-2118-4343-a9f2-7277d148cdec_iri0ye3o' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:11:50 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[497bbf5e-de5a-4b33-b801-f36ec3fa5815]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:50 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD Jul 09 10:11:50 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:50 devstack sudo[100534]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a2e617cc-83ee-4868-91a8-07405822472e" returned: 0 in 0.816s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] <== create_volume: return (2254ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:11:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.258s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3a3211-1bef-4b60-8181-285374b23c61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2e617cc-83ee-4868-91a8-07405822472e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e508c5-081a-4dad-a2b9-a30a0f200349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:50 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Volume volume-a2e617cc-83ee-4868-91a8-07405822472e (a2e617cc-83ee-4868-91a8-07405822472e): created successfully Jul 09 10:11:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7e508c5-081a-4dad-a2b9-a30a0f200349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Flow 'volume_create_manager' (b2d62ce2-87a0-406c-a4e0-bc597a47440a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:11:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-fc2cdaa1-fed6-4562-87b6-9f717c504cce tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Created volume successfully. Jul 09 10:11:51 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD" returned: 0 in 1.007s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:51 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD Jul 09 10:11:51 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:51 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=133,cinder:SELECT=113,cinder:INSERT=34,cinder:DELETE=8 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:11:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7bc980a8-fdbe-4427-8f05-032049eedf12 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7bc980a8-fdbe-4427-8f05-032049eedf12 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7bc980a8-fdbe-4427-8f05-032049eedf12 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7bc980a8-fdbe-4427-8f05-032049eedf12 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7bc980a8-fdbe-4427-8f05-032049eedf12 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7bc980a8-fdbe-4427-8f05-032049eedf12 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:51 devstack sudo[100568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:11:51 devstack sudo[100568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:52 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD" returned: 1 in 1.228s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:11:52 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] c3c9a638-2118-4343-a9f2-7277d148cdec was raw, converting to raw {{(pid=87192) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 10:11:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:52 devstack sudo[100573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 Jul 09 10:11:52 devstack sudo[100573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:52 devstack sudo[100568]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7bc980a8-fdbe-4427-8f05-032049eedf12 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.976s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:52 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-7bc980a8-fdbe-4427-8f05-032049eedf12 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:11:52 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7bc980a8-fdbe-4427-8f05-032049eedf12 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Retype volume completed successfully. Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Flow 'volume_create_manager' (e382851a-c756-45b1-8546-4df547022b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b2fdbb-d172-4eba-83a4-097ce916d934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14b2fdbb-d172-4eba-83a4-097ce916d934) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-624747190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b43323b0e4845948fef1e9789b7b16a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:11:53Z,use_quota=True,user_id='120cc2b20f6c4c60a3441cc06fd3d4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90fc1231-1234-40fe-82ac-e84829a2a255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90fc1231-1234-40fe-82ac-e84829a2a255) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44aac86b-32b9-4174-8a6c-caaa267cf18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44aac86b-32b9-4174-8a6c-caaa267cf18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad', 'volume_name': 'volume-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1fa6bdb-8af9-4069-821b-c34fe39771b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1fa6bdb-8af9-4069-821b-c34fe39771b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ae6316-e55d-46a7-b2dc-cdb1eb268897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:53 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Volume 9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad', 'volume_size': 1} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-624747190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b43323b0e4845948fef1e9789b7b16a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:11:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:11:53Z,use_quota=True,user_id='120cc2b20f6c4c60a3441cc06fd3d4fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Creating volume 9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:11:53 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Acquiring lock "cinder-a2e617cc-83ee-4868-91a8-07405822472e-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Lock "cinder-a2e617cc-83ee-4868-91a8-07405822472e-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:53 devstack sudo[100576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad 1073741824 Jul 09 10:11:53 devstack sudo[100576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Acquiring lock "cinder-quobyte-a2e617cc-83ee-4868-91a8-07405822472e" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Lock "cinder-quobyte-a2e617cc-83ee-4868-91a8-07405822472e" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9deea65-0524-4a19-9e71-f6d26845122f]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a2e617cc-83ee-4868-91a8-07405822472e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:53 devstack sudo[100580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a2e617cc-83ee-4868-91a8-07405822472e Jul 09 10:11:53 devstack sudo[100580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:54 devstack sudo[100573]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4" returned: 0 in 1.486s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:54 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_c3c9a638-2118-4343-a9f2-7277d148cdec_k1bwlo27devstack@QuobyteHD, size 0.00 MB, duration 1.49 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:11:54 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 10:11:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:54 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 1G Jul 09 10:11:54 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:54 devstack sudo[100576]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad 1073741824" returned: 0 in 1.526s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:55 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 1G" returned: 0 in 1.045s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:55 devstack sudo[100595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad Jul 09 10:11:55 devstack sudo[100595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:55 devstack sudo[100580]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a2e617cc-83ee-4868-91a8-07405822472e" returned: 0 in 1.465s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a2e617cc-83ee-4868-91a8-07405822472e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:55 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fa6687d-a086-4313-8e83-ab12eb0dddd5]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:55 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a2e617cc-83ee-4868-91a8-07405822472e Jul 09 10:11:55 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:55 devstack sudo[100598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 Jul 09 10:11:55 devstack sudo[100598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:56 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a2e617cc-83ee-4868-91a8-07405822472e" returned: 0 in 1.040s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Lock "cinder-quobyte-a2e617cc-83ee-4868-91a8-07405822472e" released by "delete_volume" :: held 2.603s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:56 devstack cinder-volume[87192]: WARNING cinder.quota [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:11:56 devstack cinder-volume[87192]: WARNING cinder.quota [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:11:56 devstack sudo[100595]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad" returned: 0 in 1.273s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] <== create_volume: return (2868ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:11:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.871s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:56 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Created reservations ['2c6b5c6a-56b9-4961-a6bf-5d4031612705', '55e104b8-c33a-47c7-91b1-9b0e70fa2803', '0bfe49af-7083-4871-8004-7773bc491988', '0c94ab15-5f79-4f9f-8391-a7d88f627e52'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:11:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54ae6316-e55d-46a7-b2dc-cdb1eb268897) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5247b0-e1d7-4a0d-9920-dc2a7b93893c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:56 devstack sudo[100598]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4" returned: 0 in 1.230s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:56 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Volume volume-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad (9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad): created successfully Jul 09 10:11:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f5247b0-e1d7-4a0d-9920-dc2a7b93893c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Flow 'volume_create_manager' (e382851a-c756-45b1-8546-4df547022b18) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:11:56 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a8b6878b-40a4-4eb1-a5d9-49783838d465 tempest-VolumesMetadataTest-828639465 None] Created volume successfully. Jul 09 10:11:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:11:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:11:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:11:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:11:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:11:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:56 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:11:56 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:56 devstack sudo[100606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 Jul 09 10:11:56 devstack sudo[100606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:57 devstack sudo[100606]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4" returned: 1 in 1.093s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:11:57 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Downloaded image c3c9a638-2118-4343-a9f2-7277d148cdec ((None, [{'url': 'file:///opt/stack/data/glance/images/c3c9a638-2118-4343-a9f2-7277d148cdec', 'metadata': {}}])) to volume 1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 successfully. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 10:11:57 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Temporary image c3c9a638-2118-4343-a9f2-7277d148cdec for user 03c141c0c9c94257abb4194fbf747077 is deleted. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 10:11:57 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Marking volume 1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 as bootable. {{(pid=87192) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 10:11:57 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Copying metadata from image c3c9a638-2118-4343-a9f2-7277d148cdec to 1f97bc51-55f7-43aa-9901-c7c05a0ac5f4. {{(pid=87192) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 10:11:57 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Creating volume glance metadata for volume 1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 backed by image c3c9a638-2118-4343-a9f2-7277d148cdec with: {'image_id': 'c3c9a638-2118-4343-a9f2-7277d148cdec', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'f33a1f0312409671efac5d4e810482c0', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87192) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 10:11:57 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=142,cinder:SELECT=112,cinder:INSERT=29,cinder:DELETE=12 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:11:57 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.085s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:57 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:11:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Deleted volume successfully. Jul 09 10:11:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-7f32cf40-9fe2-4d8e-9b60-e1bdfee1a9a7 tempest-VolumeRetypeWithoutMigrationTest-1325119235 None] Lock "cinder-a2e617cc-83ee-4868-91a8-07405822472e-delete_volume" released by "delete_volume" :: held 4.133s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:11:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b47b472-cbbe-44bb-8ed7-d71a477fda23) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4', 'volume_size': 1, 'image_id': 'c3c9a638-2118-4343-a9f2-7277d148cdec', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/c3c9a638-2118-4343-a9f2-7277d148cdec', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'f33a1f0312409671efac5d4e810482c0', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4e3b4d7f39c240f9b5948278efb69cde', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1d145384a57b9a6ac129898b71efb47af1d7e4ccafdec3ccb05460c0789301e15ee27f9b30cfa6550044835271610e6b5e8085823520f14fafa73fab52e1fafd', 'id': 'c3c9a638-2118-4343-a9f2-7277d148cdec', 'created_at': datetime.datetime(2026, 7, 9, 8, 11, 27, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 8, 11, 30, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/c3c9a638-2118-4343-a9f2-7277d148cdec/file', 'properties': {}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb73ab53-0057-4798-884e-760ded3b4bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:11:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Volume volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 (1f97bc51-55f7-43aa-9901-c7c05a0ac5f4): created successfully Jul 09 10:11:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb73ab53-0057-4798-884e-760ded3b4bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:11:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Flow 'volume_create_manager' (84d47d28-15af-42b2-870e-87f804252e44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:11:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c0dfbb62-bce4-4dd5-b663-cbaa801e8487 tempest-VolumeImageDependencyTests-1380540316 None] Created volume successfully. Jul 09 10:11:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-df710c34-b406-42ff-8d78-1f98c407865c tempest-VolumesMetadataTest-828639465 None] Acquiring lock "cinder-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-df710c34-b406-42ff-8d78-1f98c407865c tempest-VolumesMetadataTest-828639465 None] Lock "cinder-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-df710c34-b406-42ff-8d78-1f98c407865c tempest-VolumesMetadataTest-828639465 None] Acquiring lock "cinder-quobyte-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:58 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-df710c34-b406-42ff-8d78-1f98c407865c tempest-VolumesMetadataTest-828639465 None] Lock "cinder-quobyte-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad" acquired by "delete_volume" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:58 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[97754cb4-e132-400f-95fc-d0ee05e283df]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df710c34-b406-42ff-8d78-1f98c407865c tempest-VolumesMetadataTest-828639465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:58 devstack sudo[100616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad Jul 09 10:11:58 devstack sudo[100616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] Acquiring lock "cinder-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] Lock "cinder-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] Acquiring lock "cinder-quobyte-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:11:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] Lock "cinder-quobyte-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:11:59 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f817481-ada6-4aa8-baa4-e98e582b99ac]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:11:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:59 devstack sudo[100616]: pam_unix(sudo:session): session closed for user root Jul 09 10:11:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df710c34-b406-42ff-8d78-1f98c407865c tempest-VolumesMetadataTest-828639465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad" returned: 0 in 1.022s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:11:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df710c34-b406-42ff-8d78-1f98c407865c tempest-VolumesMetadataTest-828639465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:11:59 devstack sudo[100622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad Jul 09 10:11:59 devstack sudo[100622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:11:59 devstack sudo[100621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 Jul 09 10:11:59 devstack sudo[100621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:00 devstack sudo[100622]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df710c34-b406-42ff-8d78-1f98c407865c tempest-VolumesMetadataTest-828639465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad" returned: 0 in 0.995s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-df710c34-b406-42ff-8d78-1f98c407865c tempest-VolumesMetadataTest-828639465 None] Lock "cinder-quobyte-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad" released by "delete_volume" :: held 2.069s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:00 devstack sudo[100621]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4" returned: 0 in 1.090s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:00 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-df710c34-b406-42ff-8d78-1f98c407865c tempest-VolumesMetadataTest-828639465 None] Created reservations ['2a2e9602-5909-46bb-9cba-edd2a4bc1882', '94cea776-cd7b-487a-b65b-61219810b11b', '8e98284a-5c22-4379-94d4-9c6c31ee0d25', '7cecc457-fba7-442a-8970-2740565865fa'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:12:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-df710c34-b406-42ff-8d78-1f98c407865c tempest-VolumesMetadataTest-828639465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-df710c34-b406-42ff-8d78-1f98c407865c tempest-VolumesMetadataTest-828639465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-df710c34-b406-42ff-8d78-1f98c407865c tempest-VolumesMetadataTest-828639465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:12:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-df710c34-b406-42ff-8d78-1f98c407865c tempest-VolumesMetadataTest-828639465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:12:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-df710c34-b406-42ff-8d78-1f98c407865c tempest-VolumesMetadataTest-828639465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df710c34-b406-42ff-8d78-1f98c407865c tempest-VolumesMetadataTest-828639465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:00 devstack sudo[100628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 Jul 09 10:12:00 devstack sudo[100628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:00 devstack sudo[100629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:12:00 devstack sudo[100629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:01 devstack sudo[100628]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:01 devstack sudo[100629]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4" returned: 1 in 1.007s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:12:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-df710c34-b406-42ff-8d78-1f98c407865c tempest-VolumesMetadataTest-828639465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.857s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:01 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-df710c34-b406-42ff-8d78-1f98c407865c tempest-VolumesMetadataTest-828639465 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:12:01 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-df710c34-b406-42ff-8d78-1f98c407865c tempest-VolumesMetadataTest-828639465 None] Deleted volume successfully. Jul 09 10:12:01 devstack sudo[100636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4 Jul 09 10:12:01 devstack sudo[100636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-df710c34-b406-42ff-8d78-1f98c407865c tempest-VolumesMetadataTest-828639465 None] Lock "cinder-9e41b62d-9f49-4a7a-a9a1-0d2c8a8060ad-delete_volume" released by "delete_volume" :: held 3.253s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:02 devstack sudo[100636]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4" returned: 0 in 0.736s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] Lock "cinder-quobyte-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4" released by "delete_volume" :: held 2.934s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:02 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] Created reservations ['e17151c9-f87b-488c-82aa-7feded59ecfd', '1e5777ea-d196-44f5-a57f-a9190332da25', '79b24849-f7e1-43a2-967f-2e72b127cc71', 'fb153227-8934-4a0b-a6b8-167aa8a30cb6'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:12:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:12:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:12:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:02 devstack sudo[100640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:12:02 devstack sudo[100640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:03 devstack sudo[100640]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.901s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:03 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:12:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] Deleted volume successfully. Jul 09 10:12:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ffb6fc10-c712-4d5d-9f57-39be609829a8 tempest-VolumeImageDependencyTests-1380540316 None] Lock "cinder-1f97bc51-55f7-43aa-9901-c7c05a0ac5f4-delete_volume" released by "delete_volume" :: held 4.189s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:04 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Flow 'volume_create_manager' (da86116f-692a-43c4-9be0-35504e275a8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28589f85-4dd7-4038-8192-c9219c199be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (28589f85-4dd7-4038-8192-c9219c199be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-42720483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6681c32a-66a8-4d9f-92e5-9591859f1bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492a5f925d4c4098abd5c61657350b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:05Z,use_quota=True,user_id='4915befc30ae446690321ec893cb7127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e9e950-c1e2-4985-be65-80ee682c55ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a9e9e950-c1e2-4985-be65-80ee682c55ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70d16cf-5855-498c-bbbb-94a973e7df3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b70d16cf-5855-498c-bbbb-94a973e7df3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6681c32a-66a8-4d9f-92e5-9591859f1bbe', 'volume_name': 'volume-6681c32a-66a8-4d9f-92e5-9591859f1bbe', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3243144-443e-4eae-9e05-bc9dad928a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3243144-443e-4eae-9e05-bc9dad928a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5b1830-33fb-44b6-8267-0d3764402059) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:05 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Volume 6681c32a-66a8-4d9f-92e5-9591859f1bbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6681c32a-66a8-4d9f-92e5-9591859f1bbe', 'volume_size': 1} Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-42720483',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6681c32a-66a8-4d9f-92e5-9591859f1bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='492a5f925d4c4098abd5c61657350b0c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:05Z,use_quota=True,user_id='4915befc30ae446690321ec893cb7127',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Creating volume 6681c32a-66a8-4d9f-92e5-9591859f1bbe {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:12:05 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6681c32a-66a8-4d9f-92e5-9591859f1bbe 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:05 devstack sudo[100658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6681c32a-66a8-4d9f-92e5-9591859f1bbe 1073741824 Jul 09 10:12:05 devstack sudo[100658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:05 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:12:06 devstack sudo[100658]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Flow 'volume_create_manager' (93e18b3f-b749-428f-95a3-805def698f12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6961aa-f838-4bde-95b6-1de7a5b5cea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6681c32a-66a8-4d9f-92e5-9591859f1bbe 1073741824" returned: 0 in 0.946s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e6961aa-f838-4bde-95b6-1de7a5b5cea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1754807804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db8b9e0e-dd40-4219-a659-9e1b7c8724c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55684fefd174a07a69aa3b5559b4a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:06Z,use_quota=True,user_id='0c07f0f3b3f5433faebbbefcc9b6a21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087bff2b-442d-4e54-86cf-798618f2a9ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (087bff2b-442d-4e54-86cf-798618f2a9ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e75a6ed2-94d4-4f30-a6ba-ca909cfc62d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG cinder.image.glance [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Creating Keystone auth plugin from conf {{(pid=87192) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6681c32a-66a8-4d9f-92e5-9591859f1bbe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:06 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6681c32a-66a8-4d9f-92e5-9591859f1bbe Jul 09 10:12:06 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e75a6ed2-94d4-4f30-a6ba-ca909cfc62d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'db8b9e0e-dd40-4219-a659-9e1b7c8724c7', 'volume_name': 'volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7', 'volume_size': 1, 'image_id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fbd1c6e24b394cf998d7f93c3a7d72f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'created_at': datetime.datetime(2026, 7, 9, 7, 52, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 52, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb8b678-f546-4dc6-b17d-c61f166c7406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9fb8b678-f546-4dc6-b17d-c61f166c7406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe6c35b-0b2c-46c5-a38a-a427e04c5fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:06 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Volume db8b9e0e-dd40-4219-a659-9e1b7c8724c7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7', 'volume_size': 1, 'image_id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fbd1c6e24b394cf998d7f93c3a7d72f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'created_at': datetime.datetime(2026, 7, 9, 7, 52, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 52, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Trying to clone db8b9e0e-dd40-4219-a659-9e1b7c8724c7 from image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}]). {{(pid=87192) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_hg3m3eo9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 10:12:06 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Image download 20.69 MB at 20.69 MB/s Jul 09 10:12:06 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6681c32a-66a8-4d9f-92e5-9591859f1bbe" returned: 0 in 0.742s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] <== create_volume: return (1767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.770s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[afd205a0-d1a1-4eda-9c4c-d158467c1587]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_hg3m3eo9devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee5b1830-33fb-44b6-8267-0d3764402059) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6681c32a-66a8-4d9f-92e5-9591859f1bbe', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3510e9ea-e051-4990-a161-610439530c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:06 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Volume volume-6681c32a-66a8-4d9f-92e5-9591859f1bbe (6681c32a-66a8-4d9f-92e5-9591859f1bbe): created successfully Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3510e9ea-e051-4990-a161-610439530c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Flow 'volume_create_manager' (da86116f-692a-43c4-9be0-35504e275a8b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4f716b1e-9fdd-4506-89fb-611be9103e50 tempest-VolumesServicesTestJSON-1616569507 None] Created volume successfully. Jul 09 10:12:06 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_hg3m3eo9devstack@QuobyteHD Jul 09 10:12:06 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4015b915-9b56-48b1-ae22-6ac8c72e045a tempest-VolumesServicesTestJSON-1616569507 None] Acquiring lock "cinder-6681c32a-66a8-4d9f-92e5-9591859f1bbe-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4015b915-9b56-48b1-ae22-6ac8c72e045a tempest-VolumesServicesTestJSON-1616569507 None] Lock "cinder-6681c32a-66a8-4d9f-92e5-9591859f1bbe-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4015b915-9b56-48b1-ae22-6ac8c72e045a tempest-VolumesServicesTestJSON-1616569507 None] Acquiring lock "cinder-quobyte-6681c32a-66a8-4d9f-92e5-9591859f1bbe" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4015b915-9b56-48b1-ae22-6ac8c72e045a tempest-VolumesServicesTestJSON-1616569507 None] Lock "cinder-quobyte-6681c32a-66a8-4d9f-92e5-9591859f1bbe" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[16c6cb6d-839e-44e1-983c-5ce3987386ae]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4015b915-9b56-48b1-ae22-6ac8c72e045a tempest-VolumesServicesTestJSON-1616569507 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6681c32a-66a8-4d9f-92e5-9591859f1bbe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:07 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6681c32a-66a8-4d9f-92e5-9591859f1bbe Jul 09 10:12:07 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:07 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_hg3m3eo9devstack@QuobyteHD" returned: 0 in 0.795s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Temporary image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 is fetched for user 0c07f0f3b3f5433faebbbefcc9b6a21e. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Flow 'volume_create_manager' (950c4db7-e00c-40fd-a137-1098e1784e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154788b5-26d4-4f95-9c99-f4ecee7698c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (154788b5-26d4-4f95-9c99-f4ecee7698c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-529598401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65df8d33-a86c-47dd-b1da-b1d3dcb21997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7cd6c3f9744b6e93af4beba3308583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:08Z,use_quota=True,user_id='c36fae8aed544061ace764836ba4c443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa8cadd-6946-470a-afb2-ea95b3ebe8dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0fa8cadd-6946-470a-afb2-ea95b3ebe8dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74651ee-02ac-473f-bfbb-f4d0c9182bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f74651ee-02ac-473f-bfbb-f4d0c9182bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65df8d33-a86c-47dd-b1da-b1d3dcb21997', 'volume_name': 'volume-65df8d33-a86c-47dd-b1da-b1d3dcb21997', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e12a9e-2ec8-4b10-85b8-d87f943e3315) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e12a9e-2ec8-4b10-85b8-d87f943e3315) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e2d5c5-5273-49d3-badf-8b1f329b1d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:07 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Volume 65df8d33-a86c-47dd-b1da-b1d3dcb21997: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65df8d33-a86c-47dd-b1da-b1d3dcb21997', 'volume_size': 1} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-529598401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65df8d33-a86c-47dd-b1da-b1d3dcb21997,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7cd6c3f9744b6e93af4beba3308583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:08Z,use_quota=True,user_id='c36fae8aed544061ace764836ba4c443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Creating volume 65df8d33-a86c-47dd-b1da-b1d3dcb21997 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:12:07 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-65df8d33-a86c-47dd-b1da-b1d3dcb21997 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:07 devstack sudo[100676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-65df8d33-a86c-47dd-b1da-b1d3dcb21997 1073741824 Jul 09 10:12:07 devstack sudo[100676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1486cfad-3d88-42d6-a605-d6a85d31e18e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:12:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_hg3m3eo9devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:07 devstack sudo[100678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_hg3m3eo9devstack@QuobyteHD Jul 09 10:12:07 devstack sudo[100678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:08 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4015b915-9b56-48b1-ae22-6ac8c72e045a tempest-VolumesServicesTestJSON-1616569507 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6681c32a-66a8-4d9f-92e5-9591859f1bbe" returned: 0 in 0.841s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4015b915-9b56-48b1-ae22-6ac8c72e045a tempest-VolumesServicesTestJSON-1616569507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6681c32a-66a8-4d9f-92e5-9591859f1bbe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:08 devstack sudo[100685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6681c32a-66a8-4d9f-92e5-9591859f1bbe Jul 09 10:12:08 devstack sudo[100685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:08 devstack sudo[100676]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-65df8d33-a86c-47dd-b1da-b1d3dcb21997 1073741824" returned: 0 in 0.850s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:08 devstack sudo[100678]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_hg3m3eo9devstack@QuobyteHD" returned: 0 in 0.824s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-65df8d33-a86c-47dd-b1da-b1d3dcb21997 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:08 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-65df8d33-a86c-47dd-b1da-b1d3dcb21997 Jul 09 10:12:08 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:08 devstack sudo[100685]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4015b915-9b56-48b1-ae22-6ac8c72e045a tempest-VolumesServicesTestJSON-1616569507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6681c32a-66a8-4d9f-92e5-9591859f1bbe" returned: 0 in 0.659s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4015b915-9b56-48b1-ae22-6ac8c72e045a tempest-VolumesServicesTestJSON-1616569507 None] Lock "cinder-quobyte-6681c32a-66a8-4d9f-92e5-9591859f1bbe" released by "delete_volume" :: held 1.547s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:08 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-4015b915-9b56-48b1-ae22-6ac8c72e045a tempest-VolumesServicesTestJSON-1616569507 None] Created reservations ['b5d577b8-d80e-48d1-ba9d-a8e10df542bd', 'a47f4229-8033-4b00-bcdf-76bc8b9d582d', '42159a95-280a-4f44-88f2-210e4344a5c2', 'a911c748-58a3-40af-8478-c59eefba4319'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:12:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4015b915-9b56-48b1-ae22-6ac8c72e045a tempest-VolumesServicesTestJSON-1616569507 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4015b915-9b56-48b1-ae22-6ac8c72e045a tempest-VolumesServicesTestJSON-1616569507 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4015b915-9b56-48b1-ae22-6ac8c72e045a tempest-VolumesServicesTestJSON-1616569507 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:12:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4015b915-9b56-48b1-ae22-6ac8c72e045a tempest-VolumesServicesTestJSON-1616569507 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:12:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4015b915-9b56-48b1-ae22-6ac8c72e045a tempest-VolumesServicesTestJSON-1616569507 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4015b915-9b56-48b1-ae22-6ac8c72e045a tempest-VolumesServicesTestJSON-1616569507 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:08 devstack sudo[100697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:12:08 devstack sudo[100697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:09 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-65df8d33-a86c-47dd-b1da-b1d3dcb21997" returned: 0 in 0.660s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:12:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.686s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1754807804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=db8b9e0e-dd40-4219-a659-9e1b7c8724c7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55684fefd174a07a69aa3b5559b4a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:06Z,use_quota=True,user_id='0c07f0f3b3f5433faebbbefcc9b6a21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:12:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Creating volume db8b9e0e-dd40-4219-a659-9e1b7c8724c7 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:12:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:12:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:12:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:12:09 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:12:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46e2d5c5-5273-49d3-badf-8b1f329b1d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65df8d33-a86c-47dd-b1da-b1d3dcb21997', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13be2077-9c4f-41a5-aa08-2a0a144af22d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:09 devstack sudo[100700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 1073741824 Jul 09 10:12:09 devstack sudo[100700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:09 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Volume volume-65df8d33-a86c-47dd-b1da-b1d3dcb21997 (65df8d33-a86c-47dd-b1da-b1d3dcb21997): created successfully Jul 09 10:12:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13be2077-9c4f-41a5-aa08-2a0a144af22d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Flow 'volume_create_manager' (950c4db7-e00c-40fd-a137-1098e1784e2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:09 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a62aacd9-e387-4bc5-a87c-b7ba6f817cb1 tempest-ProjectReaderTests-904140232 None] Created volume successfully. Jul 09 10:12:09 devstack sudo[100697]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4015b915-9b56-48b1-ae22-6ac8c72e045a tempest-VolumesServicesTestJSON-1616569507 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.691s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:09 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-4015b915-9b56-48b1-ae22-6ac8c72e045a tempest-VolumesServicesTestJSON-1616569507 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:12:09 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4015b915-9b56-48b1-ae22-6ac8c72e045a tempest-VolumesServicesTestJSON-1616569507 None] Deleted volume successfully. Jul 09 10:12:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4015b915-9b56-48b1-ae22-6ac8c72e045a tempest-VolumesServicesTestJSON-1616569507 None] Lock "cinder-6681c32a-66a8-4d9f-92e5-9591859f1bbe-delete_volume" released by "delete_volume" :: held 2.459s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3273e4f9-e09a-4542-8a17-b4801051ff7d tempest-ProjectReaderTests-904140232 None] Acquiring lock "cinder-65df8d33-a86c-47dd-b1da-b1d3dcb21997-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:12:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3273e4f9-e09a-4542-8a17-b4801051ff7d tempest-ProjectReaderTests-904140232 None] Lock "cinder-65df8d33-a86c-47dd-b1da-b1d3dcb21997-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:12:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3273e4f9-e09a-4542-8a17-b4801051ff7d tempest-ProjectReaderTests-904140232 None] Acquiring lock "cinder-quobyte-65df8d33-a86c-47dd-b1da-b1d3dcb21997" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:12:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3273e4f9-e09a-4542-8a17-b4801051ff7d tempest-ProjectReaderTests-904140232 None] Lock "cinder-quobyte-65df8d33-a86c-47dd-b1da-b1d3dcb21997" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:12:10 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d466c557-9a29-482c-852b-8ce2d6274a1f]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:12:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3273e4f9-e09a-4542-8a17-b4801051ff7d tempest-ProjectReaderTests-904140232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-65df8d33-a86c-47dd-b1da-b1d3dcb21997 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:10 devstack sudo[100707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-65df8d33-a86c-47dd-b1da-b1d3dcb21997 Jul 09 10:12:10 devstack sudo[100707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:10 devstack sudo[100700]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 1073741824" returned: 0 in 0.993s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:10 devstack sudo[100709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 Jul 09 10:12:10 devstack sudo[100709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:11 devstack sudo[100707]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3273e4f9-e09a-4542-8a17-b4801051ff7d tempest-ProjectReaderTests-904140232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-65df8d33-a86c-47dd-b1da-b1d3dcb21997" returned: 0 in 0.854s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3273e4f9-e09a-4542-8a17-b4801051ff7d tempest-ProjectReaderTests-904140232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-65df8d33-a86c-47dd-b1da-b1d3dcb21997 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:11 devstack sudo[100709]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7" returned: 0 in 0.711s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] <== create_volume: return (1751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:12:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.756s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:11 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-65df8d33-a86c-47dd-b1da-b1d3dcb21997 Jul 09 10:12:11 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:11 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Attempting download of fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}])) to volume db8b9e0e-dd40-4219-a659-9e1b7c8724c7. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 10:12:11 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[326f72fb-ce94-4ae0-86f4-49d39494b30c]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:12:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_w4av6goo {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:11 devstack sudo[100718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_w4av6goo Jul 09 10:12:11 devstack sudo[100718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:11 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3273e4f9-e09a-4542-8a17-b4801051ff7d tempest-ProjectReaderTests-904140232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-65df8d33-a86c-47dd-b1da-b1d3dcb21997" returned: 0 in 0.757s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3273e4f9-e09a-4542-8a17-b4801051ff7d tempest-ProjectReaderTests-904140232 None] Lock "cinder-quobyte-65df8d33-a86c-47dd-b1da-b1d3dcb21997" released by "delete_volume" :: held 1.670s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:11 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-3273e4f9-e09a-4542-8a17-b4801051ff7d tempest-ProjectReaderTests-904140232 None] Created reservations ['3fd49db5-3abd-4fe5-8691-8889e365e50e', '07fc188d-fbf8-4c77-b5f2-3581767ba9fa', '9f361c42-53fd-43a9-b71b-a74a82512738', '148f26cb-2b9c-40f4-91d5-075a8456a0f4'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:12:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3273e4f9-e09a-4542-8a17-b4801051ff7d tempest-ProjectReaderTests-904140232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3273e4f9-e09a-4542-8a17-b4801051ff7d tempest-ProjectReaderTests-904140232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3273e4f9-e09a-4542-8a17-b4801051ff7d tempest-ProjectReaderTests-904140232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:12:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3273e4f9-e09a-4542-8a17-b4801051ff7d tempest-ProjectReaderTests-904140232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:12:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3273e4f9-e09a-4542-8a17-b4801051ff7d tempest-ProjectReaderTests-904140232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3273e4f9-e09a-4542-8a17-b4801051ff7d tempest-ProjectReaderTests-904140232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:12 devstack sudo[100723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:12:12 devstack sudo[100723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:12 devstack sudo[100718]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_w4av6goo" returned: 0 in 0.806s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_w4av6goo {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:12 devstack sudo[100725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_w4av6goo Jul 09 10:12:12 devstack sudo[100725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:12 devstack sudo[100723]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3273e4f9-e09a-4542-8a17-b4801051ff7d tempest-ProjectReaderTests-904140232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.714s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:12 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-3273e4f9-e09a-4542-8a17-b4801051ff7d tempest-ProjectReaderTests-904140232 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:12:12 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3273e4f9-e09a-4542-8a17-b4801051ff7d tempest-ProjectReaderTests-904140232 None] Deleted volume successfully. Jul 09 10:12:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3273e4f9-e09a-4542-8a17-b4801051ff7d tempest-ProjectReaderTests-904140232 None] Lock "cinder-65df8d33-a86c-47dd-b1da-b1d3dcb21997-delete_volume" released by "delete_volume" :: held 2.642s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:12 devstack sudo[100725]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_w4av6goo" returned: 1 in 0.884s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_w4av6goo' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:12:12 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[90a02ba4-f6f5-48bd-8b50-81766562cec0]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:12:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_hg3m3eo9devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:12 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:12:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Flow 'volume_create_manager' (b4c76e57-4f88-46cb-9782-091975977cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e76869-31f5-4f44-9561-7964edc22610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20e76869-31f5-4f44-9561-7964edc22610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-730290740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7cd6c3f9744b6e93af4beba3308583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:13Z,use_quota=True,user_id='c36fae8aed544061ace764836ba4c443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d333e5c-7b9e-46a0-8e57-81d9d837a12e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d333e5c-7b9e-46a0-8e57-81d9d837a12e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b69bd0c-5c60-47cb-8ac8-2d1bbfd2769c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2b69bd0c-5c60-47cb-8ac8-2d1bbfd2769c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7', 'volume_name': 'volume-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04aa5e6-15c7-43da-b5ab-18da11ac5122) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e04aa5e6-15c7-43da-b5ab-18da11ac5122) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36934599-f4f8-4e92-ad05-c87a86788dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:13 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Volume 7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7', 'volume_size': 1} Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:13 devstack sudo[100730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_hg3m3eo9devstack@QuobyteHD Jul 09 10:12:13 devstack sudo[100730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-730290740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b7cd6c3f9744b6e93af4beba3308583',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:13Z,use_quota=True,user_id='c36fae8aed544061ace764836ba4c443',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Creating volume 7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:12:13 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:13 devstack sudo[100732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7 1073741824 Jul 09 10:12:13 devstack sudo[100732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:13 devstack sudo[100730]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_hg3m3eo9devstack@QuobyteHD" returned: 0 in 0.788s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 was qcow2, converting to raw {{(pid=87192) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_hg3m3eo9devstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:13 devstack sudo[100740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_hg3m3eo9devstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 Jul 09 10:12:13 devstack sudo[100740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:13 devstack sudo[100732]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7 1073741824" returned: 0 in 0.916s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:14 devstack sudo[100743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7 Jul 09 10:12:14 devstack sudo[100743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:14 devstack sudo[100743]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7" returned: 0 in 0.745s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] <== create_volume: return (1713ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:12:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.716s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (36934599-f4f8-4e92-ad05-c87a86788dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50303884-0fcf-468e-bd3f-0635419745d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:14 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Volume volume-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7 (7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7): created successfully Jul 09 10:12:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50303884-0fcf-468e-bd3f-0635419745d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:14 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Flow 'volume_create_manager' (b4c76e57-4f88-46cb-9782-091975977cde) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2d7a8ad3-3eae-4414-860e-4e2291e7c4d9 tempest-ProjectReaderTests-904140232 None] Created volume successfully. Jul 09 10:12:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0a2580fe-09d0-47d6-8a4e-fdda10b2a3ce tempest-ProjectReaderTests-904140232 None] Acquiring lock "cinder-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:12:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0a2580fe-09d0-47d6-8a4e-fdda10b2a3ce tempest-ProjectReaderTests-904140232 None] Lock "cinder-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:12:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0a2580fe-09d0-47d6-8a4e-fdda10b2a3ce tempest-ProjectReaderTests-904140232 None] Acquiring lock "cinder-quobyte-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:12:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0a2580fe-09d0-47d6-8a4e-fdda10b2a3ce tempest-ProjectReaderTests-904140232 None] Lock "cinder-quobyte-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:12:15 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ee204a8-2af3-42d3-a709-3e5307341b11]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:12:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0a2580fe-09d0-47d6-8a4e-fdda10b2a3ce tempest-ProjectReaderTests-904140232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:15 devstack sudo[100752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7 Jul 09 10:12:15 devstack sudo[100752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:15 devstack sudo[100740]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_hg3m3eo9devstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7" returned: 0 in 2.169s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:15 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_hg3m3eo9devstack@QuobyteHD, size 112.00 MB, duration 2.17 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:12:15 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Converted 112.00 MB image at 51.58 MB/s Jul 09 10:12:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:15 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 1G Jul 09 10:12:15 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:16 devstack sudo[100752]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0a2580fe-09d0-47d6-8a4e-fdda10b2a3ce tempest-ProjectReaderTests-904140232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7" returned: 0 in 0.957s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0a2580fe-09d0-47d6-8a4e-fdda10b2a3ce tempest-ProjectReaderTests-904140232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:16 devstack sudo[100759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7 Jul 09 10:12:16 devstack sudo[100759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:16 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 1G" returned: 0 in 0.826s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:16 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[28c2c599-1393-4dfb-b89d-abe7145d7b69]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:12:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:16 devstack sudo[100764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 Jul 09 10:12:16 devstack sudo[100764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:16 devstack sudo[100759]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0a2580fe-09d0-47d6-8a4e-fdda10b2a3ce tempest-ProjectReaderTests-904140232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7" returned: 0 in 0.840s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0a2580fe-09d0-47d6-8a4e-fdda10b2a3ce tempest-ProjectReaderTests-904140232 None] Lock "cinder-quobyte-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7" released by "delete_volume" :: held 1.851s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:17 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-0a2580fe-09d0-47d6-8a4e-fdda10b2a3ce tempest-ProjectReaderTests-904140232 None] Created reservations ['67e83711-86f8-4d4f-9291-ad1e71618021', 'ef5cff4a-ea20-4ba4-aefc-a58215770ec7', '204f2719-86ff-4929-b321-0037eebfdc8d', 'f7268d4b-8c14-40fe-92d3-68ca6686d6bd'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:12:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0a2580fe-09d0-47d6-8a4e-fdda10b2a3ce tempest-ProjectReaderTests-904140232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0a2580fe-09d0-47d6-8a4e-fdda10b2a3ce tempest-ProjectReaderTests-904140232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0a2580fe-09d0-47d6-8a4e-fdda10b2a3ce tempest-ProjectReaderTests-904140232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:12:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0a2580fe-09d0-47d6-8a4e-fdda10b2a3ce tempest-ProjectReaderTests-904140232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:12:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0a2580fe-09d0-47d6-8a4e-fdda10b2a3ce tempest-ProjectReaderTests-904140232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0a2580fe-09d0-47d6-8a4e-fdda10b2a3ce tempest-ProjectReaderTests-904140232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:17 devstack sudo[100767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:12:17 devstack sudo[100767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:17 devstack sudo[100764]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7" returned: 0 in 1.092s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:18 devstack sudo[100771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 Jul 09 10:12:18 devstack sudo[100771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:18 devstack sudo[100767]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0a2580fe-09d0-47d6-8a4e-fdda10b2a3ce tempest-ProjectReaderTests-904140232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.335s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:18 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-0a2580fe-09d0-47d6-8a4e-fdda10b2a3ce tempest-ProjectReaderTests-904140232 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:12:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0a2580fe-09d0-47d6-8a4e-fdda10b2a3ce tempest-ProjectReaderTests-904140232 None] Deleted volume successfully. Jul 09 10:12:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0a2580fe-09d0-47d6-8a4e-fdda10b2a3ce tempest-ProjectReaderTests-904140232 None] Lock "cinder-7d4abfdc-e9d5-4c62-8664-6bb7e9a0e3b7-delete_volume" released by "delete_volume" :: held 3.522s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:18 devstack sudo[100771]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7" returned: 1 in 1.045s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:12:18 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Downloaded image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}])) to volume db8b9e0e-dd40-4219-a659-9e1b7c8724c7 successfully. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 10:12:18 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Temporary image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 for user 0c07f0f3b3f5433faebbbefcc9b6a21e is deleted. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 10:12:18 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Marking volume db8b9e0e-dd40-4219-a659-9e1b7c8724c7 as bootable. {{(pid=87192) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 10:12:18 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Copying metadata from image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 to db8b9e0e-dd40-4219-a659-9e1b7c8724c7. {{(pid=87192) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 10:12:18 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Creating volume glance metadata for volume db8b9e0e-dd40-4219-a659-9e1b7c8724c7 backed by image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87192) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 10:12:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbe6c35b-0b2c-46c5-a38a-a427e04c5fcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7', 'volume_size': 1, 'image_id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fbd1c6e24b394cf998d7f93c3a7d72f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'created_at': datetime.datetime(2026, 7, 9, 7, 52, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 52, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784239e1-c32c-474f-ae6c-5d0d2295d56f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:19 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Volume volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 (db8b9e0e-dd40-4219-a659-9e1b7c8724c7): created successfully Jul 09 10:12:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (784239e1-c32c-474f-ae6c-5d0d2295d56f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:19 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Flow 'volume_create_manager' (93e18b3f-b749-428f-95a3-805def698f12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:19 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e67df8dd-4034-43f4-8e66-5737d202dfd5 tempest-VolumesExtendTest-1071886511 None] Created volume successfully. Jul 09 10:12:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-417c2b09-7977-44a1-857b-3da8bc81bb9c tempest-VolumesExtendTest-1071886511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-417c2b09-7977-44a1-857b-3da8bc81bb9c tempest-VolumesExtendTest-1071886511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:20 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf69457-28d8-488f-9835-9e4ddb515f10]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:12:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-417c2b09-7977-44a1-857b-3da8bc81bb9c tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:20 devstack sudo[100778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 Jul 09 10:12:20 devstack sudo[100778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:20 devstack sudo[100778]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-417c2b09-7977-44a1-857b-3da8bc81bb9c tempest-VolumesExtendTest-1071886511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7" returned: 0 in 0.802s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-417c2b09-7977-44a1-857b-3da8bc81bb9c tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:21 devstack sudo[100782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 Jul 09 10:12:21 devstack sudo[100782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Flow 'volume_create_manager' (01e8ea61-de90-49a2-a461-8f555376b71e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e218e3f-1331-4a1c-bb74-960baf1f2e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e218e3f-1331-4a1c-bb74-960baf1f2e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1434072935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16edd170-2142-4014-9efe-8acb82e01b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f9543994fd4ae1b3fea21da14b5501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:21Z,use_quota=True,user_id='7a45747c109e47aa8b54d639a912f480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee7749e-d4e5-463a-b84d-67182fbe9884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ee7749e-d4e5-463a-b84d-67182fbe9884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764cae9c-723f-4e0a-8fcc-1a8923c91f1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (764cae9c-723f-4e0a-8fcc-1a8923c91f1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16edd170-2142-4014-9efe-8acb82e01b15', 'volume_name': 'volume-16edd170-2142-4014-9efe-8acb82e01b15', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9824e3db-415f-4cbb-a5ad-0186876c4575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9824e3db-415f-4cbb-a5ad-0186876c4575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720663da-1528-43f1-9d6e-4657576552df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:21 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Volume 16edd170-2142-4014-9efe-8acb82e01b15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16edd170-2142-4014-9efe-8acb82e01b15', 'volume_size': 1} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:21 devstack sudo[100782]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-417c2b09-7977-44a1-857b-3da8bc81bb9c tempest-VolumesExtendTest-1071886511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7" returned: 1 in 0.779s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-417c2b09-7977-44a1-857b-3da8bc81bb9c tempest-VolumesExtendTest-1071886511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-417c2b09-7977-44a1-857b-3da8bc81bb9c tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 2G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-417c2b09-7977-44a1-857b-3da8bc81bb9c tempest-VolumesExtendTest-1071886511 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 2G" returned: 0 in 0.074s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-417c2b09-7977-44a1-857b-3da8bc81bb9c tempest-VolumesExtendTest-1071886511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.715s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.621s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1434072935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16edd170-2142-4014-9efe-8acb82e01b15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f9543994fd4ae1b3fea21da14b5501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:21Z,use_quota=True,user_id='7a45747c109e47aa8b54d639a912f480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Creating volume 16edd170-2142-4014-9efe-8acb82e01b15 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:12:21 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:12:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-16edd170-2142-4014-9efe-8acb82e01b15 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:21 devstack sudo[100790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-16edd170-2142-4014-9efe-8acb82e01b15 1073741824 Jul 09 10:12:21 devstack sudo[100790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:21 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-417c2b09-7977-44a1-857b-3da8bc81bb9c tempest-VolumesExtendTest-1071886511 None] Extend volume completed successfully. Jul 09 10:12:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] Acquiring lock "cinder-db8b9e0e-dd40-4219-a659-9e1b7c8724c7-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:12:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] Lock "cinder-db8b9e0e-dd40-4219-a659-9e1b7c8724c7-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:12:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] Acquiring lock "cinder-quobyte-db8b9e0e-dd40-4219-a659-9e1b7c8724c7" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:12:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] Lock "cinder-quobyte-db8b9e0e-dd40-4219-a659-9e1b7c8724c7" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:12:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[14458c6b-6edc-4369-82c9-e813755a6bdb]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:12:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:22 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 Jul 09 10:12:22 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:22 devstack sudo[100790]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-16edd170-2142-4014-9efe-8acb82e01b15 1073741824" returned: 0 in 0.996s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-16edd170-2142-4014-9efe-8acb82e01b15 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:22 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-16edd170-2142-4014-9efe-8acb82e01b15 Jul 09 10:12:22 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:23 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7" returned: 0 in 0.802s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:23 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-16edd170-2142-4014-9efe-8acb82e01b15" returned: 0 in 0.704s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:12:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:23 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 Jul 09 10:12:23 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (720663da-1528-43f1-9d6e-4657576552df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16edd170-2142-4014-9efe-8acb82e01b15', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b731194b-b45d-4859-bd9b-f98311e5f9f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:23 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Volume volume-16edd170-2142-4014-9efe-8acb82e01b15 (16edd170-2142-4014-9efe-8acb82e01b15): created successfully Jul 09 10:12:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b731194b-b45d-4859-bd9b-f98311e5f9f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Flow 'volume_create_manager' (01e8ea61-de90-49a2-a461-8f555376b71e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:23 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3f2d1d02-2869-4117-8551-3669fc979bef tempest-VolumesTransfersTest-1609147147 None] Created volume successfully. Jul 09 10:12:24 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7" returned: 1 in 0.808s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:12:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:24 devstack sudo[100808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7 Jul 09 10:12:24 devstack sudo[100808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:25 devstack sudo[100808]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:25 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b7d6260c-fa59-4ff6-8ff9-861216e03b4f tempest-VolumesTransfersTest-602343088 None] Transfer volume completed successfully. Jul 09 10:12:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-db8b9e0e-dd40-4219-a659-9e1b7c8724c7" returned: 0 in 0.695s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] Lock "cinder-quobyte-db8b9e0e-dd40-4219-a659-9e1b7c8724c7" released by "delete_volume" :: held 2.375s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:25 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] Created reservations ['7414b9db-9788-4f1e-a87c-a07b8a60876d', 'cbb288b4-ed1a-484d-8b23-e4c0d85cc6cd', '7da87862-e1c2-4187-9381-689754e8b5fb', 'fb9a3297-bbe3-4b06-a1eb-a586b3d6e31d'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:12:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:12:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:12:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:25 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:12:25 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:25 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.667s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:25 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:12:25 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] Deleted volume successfully. Jul 09 10:12:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ba9c8de7-2967-47e3-bf9b-032b955903ff tempest-VolumesExtendTest-1071886511 None] Lock "cinder-db8b9e0e-dd40-4219-a659-9e1b7c8724c7-delete_volume" released by "delete_volume" :: held 3.265s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d73ef19d-d843-4b8c-8484-0c9a519f3786 tempest-VolumesTransfersTest-1034057545 None] Acquiring lock "cinder-16edd170-2142-4014-9efe-8acb82e01b15-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d73ef19d-d843-4b8c-8484-0c9a519f3786 tempest-VolumesTransfersTest-1034057545 None] Lock "cinder-16edd170-2142-4014-9efe-8acb82e01b15-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d73ef19d-d843-4b8c-8484-0c9a519f3786 tempest-VolumesTransfersTest-1034057545 None] Acquiring lock "cinder-quobyte-16edd170-2142-4014-9efe-8acb82e01b15" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d73ef19d-d843-4b8c-8484-0c9a519f3786 tempest-VolumesTransfersTest-1034057545 None] Lock "cinder-quobyte-16edd170-2142-4014-9efe-8acb82e01b15" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e75f88ea-7133-4393-93b6-063a60e5d7d7]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d73ef19d-d843-4b8c-8484-0c9a519f3786 tempest-VolumesTransfersTest-1034057545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-16edd170-2142-4014-9efe-8acb82e01b15 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:26 devstack sudo[100814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-16edd170-2142-4014-9efe-8acb82e01b15 Jul 09 10:12:26 devstack sudo[100814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Flow 'volume_create_manager' (6e6c7dca-86bd-4632-922c-65d49c489108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356191db-cb29-4b95-85d2-b42fe1de0bf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (356191db-cb29-4b95-85d2-b42fe1de0bf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1966369131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab60fff-2d8b-4739-a8b1-b7b0552c2054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55684fefd174a07a69aa3b5559b4a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:26Z,use_quota=True,user_id='0c07f0f3b3f5433faebbbefcc9b6a21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ded039-3fa4-440c-aa38-ab1e05ec4c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00ded039-3fa4-440c-aa38-ab1e05ec4c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4398589f-15c2-4b42-a5d7-c059608ad784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4398589f-15c2-4b42-a5d7-c059608ad784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ab60fff-2d8b-4739-a8b1-b7b0552c2054', 'volume_name': 'volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d941453-f000-41a0-8abe-79d61c4e9d07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d941453-f000-41a0-8abe-79d61c4e9d07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e38443-ab63-4c1b-b9ea-da4aa717c6fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:26 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Volume 0ab60fff-2d8b-4739-a8b1-b7b0552c2054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054', 'volume_size': 1} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1966369131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab60fff-2d8b-4739-a8b1-b7b0552c2054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c55684fefd174a07a69aa3b5559b4a03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:26Z,use_quota=True,user_id='0c07f0f3b3f5433faebbbefcc9b6a21e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Creating volume 0ab60fff-2d8b-4739-a8b1-b7b0552c2054 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:12:26 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:12:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:26 devstack sudo[100816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054 1073741824 Jul 09 10:12:26 devstack sudo[100816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:27 devstack sudo[100814]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d73ef19d-d843-4b8c-8484-0c9a519f3786 tempest-VolumesTransfersTest-1034057545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-16edd170-2142-4014-9efe-8acb82e01b15" returned: 0 in 0.886s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d73ef19d-d843-4b8c-8484-0c9a519f3786 tempest-VolumesTransfersTest-1034057545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-16edd170-2142-4014-9efe-8acb82e01b15 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:27 devstack sudo[100823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-16edd170-2142-4014-9efe-8acb82e01b15 Jul 09 10:12:27 devstack sudo[100823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:27 devstack sudo[100816]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054 1073741824" returned: 0 in 0.969s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:27 devstack sudo[100827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054 Jul 09 10:12:27 devstack sudo[100827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:27 devstack sudo[100823]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d73ef19d-d843-4b8c-8484-0c9a519f3786 tempest-VolumesTransfersTest-1034057545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-16edd170-2142-4014-9efe-8acb82e01b15" returned: 0 in 0.678s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d73ef19d-d843-4b8c-8484-0c9a519f3786 tempest-VolumesTransfersTest-1034057545 None] Lock "cinder-quobyte-16edd170-2142-4014-9efe-8acb82e01b15" released by "delete_volume" :: held 1.621s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d73ef19d-d843-4b8c-8484-0c9a519f3786 tempest-VolumesTransfersTest-1034057545 None] Created reservations ['8eb29694-2a40-48cb-a44e-9525c4249b49', 'bf2a2d1b-fa3f-4288-a6ab-0b146566d928', '150405a4-f1ec-4018-b3d6-686e6d072209', '34d0fb95-637c-48a5-96d1-8121dde62ca2'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d73ef19d-d843-4b8c-8484-0c9a519f3786 tempest-VolumesTransfersTest-1034057545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d73ef19d-d843-4b8c-8484-0c9a519f3786 tempest-VolumesTransfersTest-1034057545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d73ef19d-d843-4b8c-8484-0c9a519f3786 tempest-VolumesTransfersTest-1034057545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d73ef19d-d843-4b8c-8484-0c9a519f3786 tempest-VolumesTransfersTest-1034057545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d73ef19d-d843-4b8c-8484-0c9a519f3786 tempest-VolumesTransfersTest-1034057545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d73ef19d-d843-4b8c-8484-0c9a519f3786 tempest-VolumesTransfersTest-1034057545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:28 devstack sudo[100831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:12:28 devstack sudo[100831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:28 devstack sudo[100827]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054" returned: 0 in 0.720s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] <== create_volume: return (1741ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.746s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e38443-ab63-4c1b-b9ea-da4aa717c6fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13839bd-d25c-4340-85bf-e397f57d72b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:28 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Volume volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054 (0ab60fff-2d8b-4739-a8b1-b7b0552c2054): created successfully Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a13839bd-d25c-4340-85bf-e397f57d72b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Flow 'volume_create_manager' (6e6c7dca-86bd-4632-922c-65d49c489108) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:28 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6634463c-03ec-42ef-b082-65053e1284d0 tempest-VolumesExtendTest-1071886511 None] Created volume successfully. Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-108e2e44-bb7c-4f0c-9320-4c217915e574 tempest-VolumesExtendTest-1071886511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-108e2e44-bb7c-4f0c-9320-4c217915e574 tempest-VolumesExtendTest-1071886511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-108e2e44-bb7c-4f0c-9320-4c217915e574 tempest-VolumesExtendTest-1071886511 None] Creating offline snapshot d7081523-8d39-4fa9-9059-114fa75fab91 of volume 0ab60fff-2d8b-4739-a8b1-b7b0552c2054 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[38f9e693-20ca-4b76-b588-9a6bf4e5810d]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-108e2e44-bb7c-4f0c-9320-4c217915e574 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:28 devstack sudo[100831]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d73ef19d-d843-4b8c-8484-0c9a519f3786 tempest-VolumesTransfersTest-1034057545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.805s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-d73ef19d-d843-4b8c-8484-0c9a519f3786 tempest-VolumesTransfersTest-1034057545 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:12:28 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d73ef19d-d843-4b8c-8484-0c9a519f3786 tempest-VolumesTransfersTest-1034057545 None] Deleted volume successfully. Jul 09 10:12:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d73ef19d-d843-4b8c-8484-0c9a519f3786 tempest-VolumesTransfersTest-1034057545 None] Lock "cinder-16edd170-2142-4014-9efe-8acb82e01b15-delete_volume" released by "delete_volume" :: held 2.705s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:28 devstack sudo[100835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054 Jul 09 10:12:28 devstack sudo[100835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Flow 'volume_create_manager' (4e31dd4b-2f04-4066-b27f-21681e2f77d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42847b8-cb45-46a1-8b14-e8efdece6deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c42847b8-cb45-46a1-8b14-e8efdece6deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1660957905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4c96f1-e694-4ff2-a634-ec4d74a0aacc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f9543994fd4ae1b3fea21da14b5501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:29Z,use_quota=True,user_id='7a45747c109e47aa8b54d639a912f480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb8f945-ec20-4d5f-a7dd-9696969f1a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb8f945-ec20-4d5f-a7dd-9696969f1a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee8076c-8325-4566-9c2a-56d14d138d5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ee8076c-8325-4566-9c2a-56d14d138d5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d4c96f1-e694-4ff2-a634-ec4d74a0aacc', 'volume_name': 'volume-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7594d4-3b4f-47ef-9d70-06e47cf722c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea7594d4-3b4f-47ef-9d70-06e47cf722c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a466d20-82eb-4fa2-a68c-09b444278987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:29 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Volume 1d4c96f1-e694-4ff2-a634-ec4d74a0aacc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc', 'volume_size': 1} Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:29 devstack sudo[100835]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-108e2e44-bb7c-4f0c-9320-4c217915e574 tempest-VolumesExtendTest-1071886511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054" returned: 0 in 0.855s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-108e2e44-bb7c-4f0c-9320-4c217915e574 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:29 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91 1G Jul 09 10:12:29 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:29 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:12:29 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:30 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.695s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:12:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:12:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:12:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:12:30 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-108e2e44-bb7c-4f0c-9320-4c217915e574 tempest-VolumesExtendTest-1071886511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91 1G" returned: 0 in 0.835s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-108e2e44-bb7c-4f0c-9320-4c217915e574 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:30 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91 Jul 09 10:12:30 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:31 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-108e2e44-bb7c-4f0c-9320-4c217915e574 tempest-VolumesExtendTest-1071886511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91" returned: 0 in 0.922s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:31 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-108e2e44-bb7c-4f0c-9320-4c217915e574 tempest-VolumesExtendTest-1071886511 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91 is being set with open permissions: ugo+rw Jul 09 10:12:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-108e2e44-bb7c-4f0c-9320-4c217915e574 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:31 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91 Jul 09 10:12:31 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:32 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-108e2e44-bb7c-4f0c-9320-4c217915e574 tempest-VolumesExtendTest-1071886511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91" returned: 0 in 0.661s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-108e2e44-bb7c-4f0c-9320-4c217915e574 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:32 devstack sudo[100893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.info Jul 09 10:12:32 devstack sudo[100893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:32 devstack sudo[100893]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-108e2e44-bb7c-4f0c-9320-4c217915e574 tempest-VolumesExtendTest-1071886511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.info" returned: 0 in 0.705s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:32 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-108e2e44-bb7c-4f0c-9320-4c217915e574 tempest-VolumesExtendTest-1071886511 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.info is being set with open permissions: ugo+rw Jul 09 10:12:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-108e2e44-bb7c-4f0c-9320-4c217915e574 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:32 devstack sudo[100903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.info Jul 09 10:12:32 devstack sudo[100903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:33 devstack sudo[100903]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-108e2e44-bb7c-4f0c-9320-4c217915e574 tempest-VolumesExtendTest-1071886511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.info" returned: 0 in 0.695s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-108e2e44-bb7c-4f0c-9320-4c217915e574 tempest-VolumesExtendTest-1071886511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.771s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.321s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1660957905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d4c96f1-e694-4ff2-a634-ec4d74a0aacc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d6f9543994fd4ae1b3fea21da14b5501',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:29Z,use_quota=True,user_id='7a45747c109e47aa8b54d639a912f480',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:12:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Creating volume 1d4c96f1-e694-4ff2-a634-ec4d74a0aacc {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:12:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:12:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:12:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:12:33 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:12:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:33 devstack sudo[100906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc 1073741824 Jul 09 10:12:33 devstack sudo[100906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-108e2e44-bb7c-4f0c-9320-4c217915e574 tempest-VolumesExtendTest-1071886511 None] Create snapshot completed successfully Jul 09 10:12:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c6a7721e-82a7-468c-9699-d5b00b4de54f tempest-VolumesExtendTest-1071886511 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:34 devstack sudo[100906]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc 1073741824" returned: 0 in 0.970s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:34 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc Jul 09 10:12:34 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:35 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc" returned: 0 in 0.787s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:12:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.801s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c6a7721e-82a7-468c-9699-d5b00b4de54f tempest-VolumesExtendTest-1071886511 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.225s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a466d20-82eb-4fa2-a68c-09b444278987) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46793fb-fa6a-477d-9176-316ed6ccde58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:35 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ee1c886-be3a-42b5-9428-08e2ac3abb7a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:12:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6a7721e-82a7-468c-9699-d5b00b4de54f tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:35 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Volume volume-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc (1d4c96f1-e694-4ff2-a634-ec4d74a0aacc): created successfully Jul 09 10:12:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d46793fb-fa6a-477d-9176-316ed6ccde58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Flow 'volume_create_manager' (4e31dd4b-2f04-4066-b27f-21681e2f77d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:35 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9caf175e-c100-4841-bb8a-c66dc5eb4d7f tempest-VolumesTransfersTest-1609147147 None] Created volume successfully. Jul 09 10:12:35 devstack sudo[100915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054 Jul 09 10:12:35 devstack sudo[100915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-7846c09c-df5c-41b6-a53e-a0718e2d7f55 req-43d7b038-2eb2-4772-86ff-2315a74f1212 tempest-TestStampPattern-1520710234 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f686f274-9f5b-4fdd-bea2-7c4518dbe222 tempest-VolumesTransfersTest-1034057545 None] Acquiring lock "cinder-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:12:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f686f274-9f5b-4fdd-bea2-7c4518dbe222 tempest-VolumesTransfersTest-1034057545 None] Lock "cinder-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:12:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f686f274-9f5b-4fdd-bea2-7c4518dbe222 tempest-VolumesTransfersTest-1034057545 None] Acquiring lock "cinder-quobyte-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:12:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f686f274-9f5b-4fdd-bea2-7c4518dbe222 tempest-VolumesTransfersTest-1034057545 None] Lock "cinder-quobyte-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:12:36 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0720eaa2-e5a3-4c0b-bbb9-85c0d28149b2]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:12:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f686f274-9f5b-4fdd-bea2-7c4518dbe222 tempest-VolumesTransfersTest-1034057545 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:36 devstack sudo[100925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc Jul 09 10:12:36 devstack sudo[100925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:36 devstack sudo[100915]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6a7721e-82a7-468c-9699-d5b00b4de54f tempest-VolumesExtendTest-1071886511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054" returned: 0 in 1.156s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6a7721e-82a7-468c-9699-d5b00b4de54f tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91 2G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6a7721e-82a7-468c-9699-d5b00b4de54f tempest-VolumesExtendTest-1071886511 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91 2G" returned: 0 in 0.166s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c6a7721e-82a7-468c-9699-d5b00b4de54f tempest-VolumesExtendTest-1071886511 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.369s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-7846c09c-df5c-41b6-a53e-a0718e2d7f55 req-43d7b038-2eb2-4772-86ff-2315a74f1212 tempest-TestStampPattern-1520710234 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.821s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:36 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ccfd9bd-d18e-422d-bf10-211f674b60f7]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:12:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-7846c09c-df5c-41b6-a53e-a0718e2d7f55 req-43d7b038-2eb2-4772-86ff-2315a74f1212 tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:36 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c6a7721e-82a7-468c-9699-d5b00b4de54f tempest-VolumesExtendTest-1071886511 None] Extend volume completed successfully. Jul 09 10:12:36 devstack sudo[100934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5 Jul 09 10:12:36 devstack sudo[100934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:37 devstack sudo[100925]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f686f274-9f5b-4fdd-bea2-7c4518dbe222 tempest-VolumesTransfersTest-1034057545 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc" returned: 0 in 0.875s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f686f274-9f5b-4fdd-bea2-7c4518dbe222 tempest-VolumesTransfersTest-1034057545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:37 devstack sudo[100939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc Jul 09 10:12:37 devstack sudo[100939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] Acquiring lock "cinder-d7081523-8d39-4fa9-9059-114fa75fab91-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:12:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] Lock "cinder-d7081523-8d39-4fa9-9059-114fa75fab91-delete_snapshot" acquired by "delete_snapshot" :: waited 0.039s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:12:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] Acquiring lock "cinder-quobyte-0ab60fff-2d8b-4739-a8b1-b7b0552c2054" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:12:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] Lock "cinder-quobyte-0ab60fff-2d8b-4739-a8b1-b7b0552c2054" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:12:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] Acquiring lock "cinder-quobyte-d7081523-8d39-4fa9-9059-114fa75fab91" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:12:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] Lock "cinder-quobyte-d7081523-8d39-4fa9-9059-114fa75fab91" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:12:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] Deleting offline snapshot d7081523-8d39-4fa9-9059-114fa75fab91 of volume 0ab60fff-2d8b-4739-a8b1-b7b0552c2054 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:12:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] snapshot_file for this snap is: volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:12:37 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[bde6c580-9d17-403b-ad9e-25c59bb5da6a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:12:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:37 devstack sudo[100939]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f686f274-9f5b-4fdd-bea2-7c4518dbe222 tempest-VolumesTransfersTest-1034057545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc" returned: 0 in 0.784s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f686f274-9f5b-4fdd-bea2-7c4518dbe222 tempest-VolumesTransfersTest-1034057545 None] Lock "cinder-quobyte-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc" released by "delete_volume" :: held 1.713s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:37 devstack sudo[100934]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-7846c09c-df5c-41b6-a53e-a0718e2d7f55 req-43d7b038-2eb2-4772-86ff-2315a74f1212 tempest-TestStampPattern-1520710234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5" returned: 0 in 1.073s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-7846c09c-df5c-41b6-a53e-a0718e2d7f55 req-43d7b038-2eb2-4772-86ff-2315a74f1212 tempest-TestStampPattern-1520710234 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.101s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:37 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-f686f274-9f5b-4fdd-bea2-7c4518dbe222 tempest-VolumesTransfersTest-1034057545 None] Created reservations ['1ba9cdfa-46ba-402e-b00e-8e62172a6f0b', '84b3de1e-a2c3-4a5b-aa25-f85cd5ce6399', '3200f75c-3ccb-4775-bdd0-df87288636ee', '8bc52160-db84-4d49-9eed-01a90afe90fa'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:12:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-7846c09c-df5c-41b6-a53e-a0718e2d7f55 req-43d7b038-2eb2-4772-86ff-2315a74f1212 tempest-TestStampPattern-1520710234 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b223d013-1055-4fe6-832b-b056a9a25f5f', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:12:37 devstack sudo[100950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91 Jul 09 10:12:37 devstack sudo[100950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f686f274-9f5b-4fdd-bea2-7c4518dbe222 tempest-VolumesTransfersTest-1034057545 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f686f274-9f5b-4fdd-bea2-7c4518dbe222 tempest-VolumesTransfersTest-1034057545 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f686f274-9f5b-4fdd-bea2-7c4518dbe222 tempest-VolumesTransfersTest-1034057545 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:12:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f686f274-9f5b-4fdd-bea2-7c4518dbe222 tempest-VolumesTransfersTest-1034057545 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:12:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f686f274-9f5b-4fdd-bea2-7c4518dbe222 tempest-VolumesTransfersTest-1034057545 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f686f274-9f5b-4fdd-bea2-7c4518dbe222 tempest-VolumesTransfersTest-1034057545 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:38 devstack sudo[100956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:12:38 devstack sudo[100956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:38 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-7846c09c-df5c-41b6-a53e-a0718e2d7f55 req-43d7b038-2eb2-4772-86ff-2315a74f1212 tempest-TestStampPattern-1520710234 None] attachment_update completed successfully. Jul 09 10:12:38 devstack sudo[100950]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91" returned: 0 in 1.133s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:12:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78ea125-7077-426e-b57e-1b1ff87bc00d]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:12:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:38 devstack sudo[100956]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f686f274-9f5b-4fdd-bea2-7c4518dbe222 tempest-VolumesTransfersTest-1034057545 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.942s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:38 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-f686f274-9f5b-4fdd-bea2-7c4518dbe222 tempest-VolumesTransfersTest-1034057545 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:12:39 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f686f274-9f5b-4fdd-bea2-7c4518dbe222 tempest-VolumesTransfersTest-1034057545 None] Deleted volume successfully. Jul 09 10:12:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f686f274-9f5b-4fdd-bea2-7c4518dbe222 tempest-VolumesTransfersTest-1034057545 None] Lock "cinder-1d4c96f1-e694-4ff2-a634-ec4d74a0aacc-delete_volume" released by "delete_volume" :: held 2.998s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:39 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054 Jul 09 10:12:39 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:39 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054" returned: 0 in 1.065s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:40 devstack sudo[101357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91 Jul 09 10:12:40 devstack sudo[101357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:41 devstack sudo[101357]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91" returned: 0 in 1.162s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:41 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91 Jul 09 10:12:41 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:41 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054.d7081523-8d39-4fa9-9059-114fa75fab91" returned: 0 in 0.739s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] Lock "cinder-quobyte-d7081523-8d39-4fa9-9059-114fa75fab91" released by "_delete_snapshot" :: held 4.278s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] Lock "cinder-quobyte-0ab60fff-2d8b-4739-a8b1-b7b0552c2054" released by "delete_snapshot" :: held 4.333s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:42 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] Created reservations ['b3671ef2-41b5-455c-afc1-a99a830762f0', 'f7e3c222-03bb-4bbd-8fde-ae9149201ccc', '3d64422c-2ef9-42b6-bba2-42811aec6b4b', '9a5e9fbc-08c3-45a7-a782-c01f91e81ac2'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:12:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] Delete snapshot completed successfully. Jul 09 10:12:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e4407790-489a-4fe6-b45f-fdd509fdc094 tempest-VolumesExtendTest-1071886511 None] Lock "cinder-d7081523-8d39-4fa9-9059-114fa75fab91-delete_snapshot" released by "delete_snapshot" :: held 4.539s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bcc2fea2-659b-453a-a882-a7ea41109f11 tempest-VolumesExtendTest-1071886511 None] Acquiring lock "cinder-0ab60fff-2d8b-4739-a8b1-b7b0552c2054-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:12:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bcc2fea2-659b-453a-a882-a7ea41109f11 tempest-VolumesExtendTest-1071886511 None] Lock "cinder-0ab60fff-2d8b-4739-a8b1-b7b0552c2054-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:12:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bcc2fea2-659b-453a-a882-a7ea41109f11 tempest-VolumesExtendTest-1071886511 None] Acquiring lock "cinder-quobyte-0ab60fff-2d8b-4739-a8b1-b7b0552c2054" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:12:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bcc2fea2-659b-453a-a882-a7ea41109f11 tempest-VolumesExtendTest-1071886511 None] Lock "cinder-quobyte-0ab60fff-2d8b-4739-a8b1-b7b0552c2054" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:12:43 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ea2b2ea-9b34-48dd-a4b1-96776d3a45ab]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:12:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bcc2fea2-659b-453a-a882-a7ea41109f11 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:43 devstack sudo[101374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054 Jul 09 10:12:43 devstack sudo[101374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:44 devstack sudo[101374]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bcc2fea2-659b-453a-a882-a7ea41109f11 tempest-VolumesExtendTest-1071886511 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054" returned: 0 in 0.914s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bcc2fea2-659b-453a-a882-a7ea41109f11 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:44 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054 Jul 09 10:12:44 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:45 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bcc2fea2-659b-453a-a882-a7ea41109f11 tempest-VolumesExtendTest-1071886511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0ab60fff-2d8b-4739-a8b1-b7b0552c2054" returned: 0 in 1.007s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bcc2fea2-659b-453a-a882-a7ea41109f11 tempest-VolumesExtendTest-1071886511 None] Lock "cinder-quobyte-0ab60fff-2d8b-4739-a8b1-b7b0552c2054" released by "delete_volume" :: held 2.037s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:45 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-bcc2fea2-659b-453a-a882-a7ea41109f11 tempest-VolumesExtendTest-1071886511 None] Created reservations ['72ff06af-fe8b-48ba-b445-b612fbe963ee', 'e310ef4b-9290-41df-9e6a-34968aed4450', '3812aeb9-a6db-443f-b0f1-38ce39c01fea', 'ce4c2f4c-9fc6-4751-b90b-2f18a403285b'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:12:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bcc2fea2-659b-453a-a882-a7ea41109f11 tempest-VolumesExtendTest-1071886511 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bcc2fea2-659b-453a-a882-a7ea41109f11 tempest-VolumesExtendTest-1071886511 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bcc2fea2-659b-453a-a882-a7ea41109f11 tempest-VolumesExtendTest-1071886511 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:12:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bcc2fea2-659b-453a-a882-a7ea41109f11 tempest-VolumesExtendTest-1071886511 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:12:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bcc2fea2-659b-453a-a882-a7ea41109f11 tempest-VolumesExtendTest-1071886511 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bcc2fea2-659b-453a-a882-a7ea41109f11 tempest-VolumesExtendTest-1071886511 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:45 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:12:45 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:45 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-3f30f6d3-48d7-481f-82bb-504f94e3e88b req-f1ebd332-0d47-4645-9609-0b8dfe72b819 tempest-TestStampPattern-1520710234 None] Terminate volume connection completed successfully. Jul 09 10:12:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-3f30f6d3-48d7-481f-82bb-504f94e3e88b req-f1ebd332-0d47-4645-9609-0b8dfe72b819 tempest-TestStampPattern-1520710234 None] Deleting attachment b223d013-1055-4fe6-832b-b056a9a25f5f. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:12:46 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bcc2fea2-659b-453a-a882-a7ea41109f11 tempest-VolumesExtendTest-1071886511 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.779s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:46 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-bcc2fea2-659b-453a-a882-a7ea41109f11 tempest-VolumesExtendTest-1071886511 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:12:46 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-bcc2fea2-659b-453a-a882-a7ea41109f11 tempest-VolumesExtendTest-1071886511 None] Deleted volume successfully. Jul 09 10:12:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bcc2fea2-659b-453a-a882-a7ea41109f11 tempest-VolumesExtendTest-1071886511 None] Lock "cinder-0ab60fff-2d8b-4739-a8b1-b7b0552c2054-delete_volume" released by "delete_volume" :: held 3.155s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Flow 'volume_create_manager' (32e38c40-165b-416c-b0aa-08c1788df6c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ddc303-313e-4ad5-9e37-0bdab98659a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0ddc303-313e-4ad5-9e37-0bdab98659a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1186365895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130be66f-b609-4335-b953-2eb77ebc833c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fe361d8b7dd40dabfe7d38a0f459e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:49Z,use_quota=True,user_id='6f30c620b2b1402ba8e3f4cf0c64580f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac91d436-0eca-4291-8259-6ecceb17c4f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac91d436-0eca-4291-8259-6ecceb17c4f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff08bcd-441e-4486-a73b-be681b90c6ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eff08bcd-441e-4486-a73b-be681b90c6ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '130be66f-b609-4335-b953-2eb77ebc833c', 'volume_name': 'volume-130be66f-b609-4335-b953-2eb77ebc833c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c2e88b-dc1a-48f1-b011-dc378fc9df2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91c2e88b-dc1a-48f1-b011-dc378fc9df2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc4fe69-0234-4504-bc3c-eb519758a485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:49 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Volume 130be66f-b609-4335-b953-2eb77ebc833c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-130be66f-b609-4335-b953-2eb77ebc833c', 'volume_size': 1} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1186365895',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=130be66f-b609-4335-b953-2eb77ebc833c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fe361d8b7dd40dabfe7d38a0f459e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:49Z,use_quota=True,user_id='6f30c620b2b1402ba8e3f4cf0c64580f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Creating volume 130be66f-b609-4335-b953-2eb77ebc833c {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:12:49 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:12:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:49 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c 1073741824 Jul 09 10:12:49 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:50 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c 1073741824" returned: 0 in 1.129s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:50 devstack sudo[101441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c Jul 09 10:12:50 devstack sudo[101441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:51 devstack sudo[101441]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c" returned: 0 in 1.012s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] <== create_volume: return (2197ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.202s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ebc4fe69-0234-4504-bc3c-eb519758a485) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-130be66f-b609-4335-b953-2eb77ebc833c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26494e1-676a-481f-8d62-5ef510b7a308) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:51 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Volume volume-130be66f-b609-4335-b953-2eb77ebc833c (130be66f-b609-4335-b953-2eb77ebc833c): created successfully Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f26494e1-676a-481f-8d62-5ef510b7a308) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Flow 'volume_create_manager' (32e38c40-165b-416c-b0aa-08c1788df6c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:51 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9d82cf20-01c4-4150-8824-983bdf389f9a tempest-SnapshotDependencyTests-1009740048 None] Created volume successfully. Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Flow 'volume_create_manager' (7146c8da-286e-4862-9b5a-63f950709952) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f55ab8-0340-4788-93ba-e8b77c4587f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11f55ab8-0340-4788-93ba-e8b77c4587f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2135356031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dabfd4745104a2995300f9f716ceefc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:52Z,use_quota=True,user_id='d268ef6144954b2a9292b0dcf103c949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0aee099-5197-412b-9997-56a654f13098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0aee099-5197-412b-9997-56a654f13098) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a17fc6e-638e-4700-a411-f84e1213dd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a17fc6e-638e-4700-a411-f84e1213dd5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1', 'volume_name': 'volume-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb336381-009b-419a-8000-a303a4c8f6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb336381-009b-419a-8000-a303a4c8f6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b552d47d-6faf-4b9d-b44d-dfb865832af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:51 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Volume 4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1', 'volume_size': 1} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2135356031',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dabfd4745104a2995300f9f716ceefc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:52Z,use_quota=True,user_id='d268ef6144954b2a9292b0dcf103c949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Creating volume 4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:12:51 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:12:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:51 devstack sudo[101470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1 1073741824 Jul 09 10:12:51 devstack sudo[101470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:52 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=107,cinder:UPDATE=127,cinder:INSERT=36,cinder:DELETE=13 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:12:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eb55e647-2011-40c3-97f4-46761a1be69c tempest-SnapshotDependencyTests-1009740048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:52 devstack sudo[101470]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1 1073741824" returned: 0 in 1.057s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:52 devstack sudo[101478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1 Jul 09 10:12:52 devstack sudo[101478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:53 devstack sudo[101478]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1" returned: 0 in 0.804s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] <== create_volume: return (1926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:12:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.929s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eb55e647-2011-40c3-97f4-46761a1be69c tempest-SnapshotDependencyTests-1009740048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.983s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b552d47d-6faf-4b9d-b44d-dfb865832af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b167348c-ce66-44db-998a-4bb52e52de23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-eb55e647-2011-40c3-97f4-46761a1be69c tempest-SnapshotDependencyTests-1009740048 None] Creating offline snapshot 52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1 of volume 130be66f-b609-4335-b953-2eb77ebc833c {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:12:53 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Volume volume-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1 (4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1): created successfully Jul 09 10:12:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b167348c-ce66-44db-998a-4bb52e52de23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Flow 'volume_create_manager' (7146c8da-286e-4862-9b5a-63f950709952) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:53 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad7ef46a-94b6-4684-a27a-ccc16c931326]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:12:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb55e647-2011-40c3-97f4-46761a1be69c tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:53 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3f1bd439-ea24-4507-aa29-49aa6e21357d tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Created volume successfully. Jul 09 10:12:53 devstack sudo[101481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c Jul 09 10:12:53 devstack sudo[101481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:54 devstack sudo[101481]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb55e647-2011-40c3-97f4-46761a1be69c tempest-SnapshotDependencyTests-1009740048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c" returned: 0 in 1.038s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb55e647-2011-40c3-97f4-46761a1be69c tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:54 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1 1G Jul 09 10:12:54 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:55 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Flow 'volume_create_manager' (2ec94e14-af42-4d43-aa4b-c844afe08dca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07eaf7d0-7fe7-4db1-9559-a03fe8559bd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07eaf7d0-7fe7-4db1-9559-a03fe8559bd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-685395151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3a2d84-03df-4823-abd9-e6abc3ae1d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dabfd4745104a2995300f9f716ceefc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:56Z,use_quota=True,user_id='d268ef6144954b2a9292b0dcf103c949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6171a186-188a-4f18-97f3-892790c5872a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6171a186-188a-4f18-97f3-892790c5872a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835e0432-e955-41fb-9482-87e5ecf97e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (835e0432-e955-41fb-9482-87e5ecf97e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf3a2d84-03df-4823-abd9-e6abc3ae1d89', 'volume_name': 'volume-bf3a2d84-03df-4823-abd9-e6abc3ae1d89', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3e28c2-633d-4a92-8e77-4201d827df86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b3e28c2-633d-4a92-8e77-4201d827df86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea8e94f-cc02-4712-8719-174a752383dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:56 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Volume bf3a2d84-03df-4823-abd9-e6abc3ae1d89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf3a2d84-03df-4823-abd9-e6abc3ae1d89', 'volume_size': 1} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:56 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb55e647-2011-40c3-97f4-46761a1be69c tempest-SnapshotDependencyTests-1009740048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1 1G" returned: 0 in 1.381s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb55e647-2011-40c3-97f4-46761a1be69c tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-130be66f-b609-4335-b953-2eb77ebc833c -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:56 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-130be66f-b609-4335-b953-2eb77ebc833c -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1 Jul 09 10:12:56 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Flow 'volume_create_manager' (b7fa50bc-e119-47a8-a208-b59875ca381d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8a559b-7081-4ce0-8343-6c308c829c94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac8a559b-7081-4ce0-8343-6c308c829c94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1368322038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403deda2-b534-4c35-ad64-da4efaf533bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dabfd4745104a2995300f9f716ceefc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:56Z,use_quota=True,user_id='d268ef6144954b2a9292b0dcf103c949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628fdf1c-af37-408e-a3ef-339e10e4d9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (628fdf1c-af37-408e-a3ef-339e10e4d9b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ab2166-7f9d-426c-ba0f-b831322c4895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2ab2166-7f9d-426c-ba0f-b831322c4895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '403deda2-b534-4c35-ad64-da4efaf533bd', 'volume_name': 'volume-403deda2-b534-4c35-ad64-da4efaf533bd', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c1684fd-5cdf-4d23-857e-20830e54b4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2c1684fd-5cdf-4d23-857e-20830e54b4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2179d55-d315-405a-8a6f-cef01f6983be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:56 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Volume 403deda2-b534-4c35-ad64-da4efaf533bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-403deda2-b534-4c35-ad64-da4efaf533bd', 'volume_size': 1} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Flow 'volume_create_manager' (f59d2d2e-c6b4-4c15-86e0-d6cd6340c610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be9b59e2-f09b-4ccd-ae64-2e3aad7436a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be9b59e2-f09b-4ccd-ae64-2e3aad7436a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-899450391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a4fc5a-e108-4d0a-9fab-88effe04c756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dabfd4745104a2995300f9f716ceefc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:57Z,use_quota=True,user_id='d268ef6144954b2a9292b0dcf103c949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b74092-3154-4cba-a915-cd5e341a09c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4b74092-3154-4cba-a915-cd5e341a09c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cddcaa4-f497-4767-b915-6425502f0882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cddcaa4-f497-4767-b915-6425502f0882) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5a4fc5a-e108-4d0a-9fab-88effe04c756', 'volume_name': 'volume-b5a4fc5a-e108-4d0a-9fab-88effe04c756', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5cef8c-ee9f-47ec-abe5-d712b8c5d05e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c5cef8c-ee9f-47ec-abe5-d712b8c5d05e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a4c79b-0fa6-42f3-b735-97cdcec8b96b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Volume b5a4fc5a-e108-4d0a-9fab-88effe04c756: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5a4fc5a-e108-4d0a-9fab-88effe04c756', 'volume_size': 1} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e02eec8a-65de-4d56-94ba-8e58bdd1d4b1 tempest-TestStampPattern-1520710234 None] Acquiring lock "cinder-9e04905c-e7c5-4527-ace2-52e36d1e20c5-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e02eec8a-65de-4d56-94ba-8e58bdd1d4b1 tempest-TestStampPattern-1520710234 None] Lock "cinder-9e04905c-e7c5-4527-ace2-52e36d1e20c5-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e02eec8a-65de-4d56-94ba-8e58bdd1d4b1 tempest-TestStampPattern-1520710234 None] Acquiring lock "cinder-quobyte-9e04905c-e7c5-4527-ace2-52e36d1e20c5" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e02eec8a-65de-4d56-94ba-8e58bdd1d4b1 tempest-TestStampPattern-1520710234 None] Lock "cinder-quobyte-9e04905c-e7c5-4527-ace2-52e36d1e20c5" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d09831ba-5b47-4f63-9ed3-6e4d8a793bda]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e02eec8a-65de-4d56-94ba-8e58bdd1d4b1 tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:12:57 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:57 devstack sudo[101497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5 Jul 09 10:12:57 devstack sudo[101497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Flow 'volume_create_manager' (6d4a43ac-e8db-4cf8-99eb-53a60b80d236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2385beed-87c0-42e9-8471-858e84216208) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb55e647-2011-40c3-97f4-46761a1be69c tempest-SnapshotDependencyTests-1009740048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-130be66f-b609-4335-b953-2eb77ebc833c -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1" returned: 0 in 1.363s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:57 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-eb55e647-2011-40c3-97f4-46761a1be69c tempest-SnapshotDependencyTests-1009740048 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1 is being set with open permissions: ugo+rw Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb55e647-2011-40c3-97f4-46761a1be69c tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2385beed-87c0-42e9-8471-858e84216208) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-206088351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4d0915-00ce-460d-b374-9108a3789da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dabfd4745104a2995300f9f716ceefc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:57Z,use_quota=True,user_id='d268ef6144954b2a9292b0dcf103c949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:57 devstack sudo[101499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1 Jul 09 10:12:57 devstack sudo[101499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7c0405-d928-4237-aa0f-6060d8497c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f7c0405-d928-4237-aa0f-6060d8497c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27064106-7c28-4ba3-ae7f-189b7f0bd304) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27064106-7c28-4ba3-ae7f-189b7f0bd304) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f4d0915-00ce-460d-b374-9108a3789da6', 'volume_name': 'volume-1f4d0915-00ce-460d-b374-9108a3789da6', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b1a405-7a03-40e1-9079-8d82c30566e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f9b1a405-7a03-40e1-9079-8d82c30566e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08dde7a8-b76d-4cc0-a4fb-282c8b88a917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Volume 1f4d0915-00ce-460d-b374-9108a3789da6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f4d0915-00ce-460d-b374-9108a3789da6', 'volume_size': 1} Jul 09 10:12:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:58 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=96,cinder:INSERT=38,cinder:UPDATE=128,cinder:DELETE=7 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:12:58 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:12:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Flow 'volume_create_manager' (71ee4cc6-c715-4d4c-951d-3a2992708f11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d461a63-b42b-45d0-9cf3-438e37242e2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d461a63-b42b-45d0-9cf3-438e37242e2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1144578724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dabfd4745104a2995300f9f716ceefc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:58Z,use_quota=True,user_id='d268ef6144954b2a9292b0dcf103c949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252ce0c7-7908-41f7-9044-74f63c914232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (252ce0c7-7908-41f7-9044-74f63c914232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ad397b-6114-4b8e-87ca-ed54c1139008) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26ad397b-6114-4b8e-87ca-ed54c1139008) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95', 'volume_name': 'volume-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0304a9b6-fcb2-4d58-9c5b-a78d317eaae7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0304a9b6-fcb2-4d58-9c5b-a78d317eaae7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b249b711-99bf-4bbb-a656-125159232c5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:58 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Volume 75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95', 'volume_size': 1} Jul 09 10:12:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:58 devstack sudo[101499]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb55e647-2011-40c3-97f4-46761a1be69c tempest-SnapshotDependencyTests-1009740048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1" returned: 0 in 1.033s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:58 devstack sudo[101497]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e02eec8a-65de-4d56-94ba-8e58bdd1d4b1 tempest-TestStampPattern-1520710234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5" returned: 0 in 1.367s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e02eec8a-65de-4d56-94ba-8e58bdd1d4b1 tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:58 devstack sudo[101506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5 Jul 09 10:12:58 devstack sudo[101506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb55e647-2011-40c3-97f4-46761a1be69c tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:58 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.info Jul 09 10:12:58 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:58 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:12:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Flow 'volume_create_manager' (896aa508-c2e1-4261-8698-fa44009c4565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:12:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47f230a-f62a-4f54-999b-2543cb05f744) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d47f230a-f62a-4f54-999b-2543cb05f744) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-220426449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149c9a9d-da68-4042-8cd2-d6ce95819c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1e71f47be14fd8bc6a5078ca667635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:59Z,use_quota=True,user_id='6054c3af39b14f0f867bd7612ee12856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77117c64-e83c-45f5-b3d4-1670a5b37769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77117c64-e83c-45f5-b3d4-1670a5b37769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d2b4b6-2dee-40b9-9094-7817c348a0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67d2b4b6-2dee-40b9-9094-7817c348a0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '149c9a9d-da68-4042-8cd2-d6ce95819c49', 'volume_name': 'volume-149c9a9d-da68-4042-8cd2-d6ce95819c49', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c4720e-0355-4d0e-bd8d-8e7114be7181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c4720e-0355-4d0e-bd8d-8e7114be7181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:12:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31bdd5c-115c-4824-9c01-1db1cc353c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:12:59 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Volume 149c9a9d-da68-4042-8cd2-d6ce95819c49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-149c9a9d-da68-4042-8cd2-d6ce95819c49', 'volume_size': 1} Jul 09 10:12:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:59 devstack sudo[101506]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e02eec8a-65de-4d56-94ba-8e58bdd1d4b1 tempest-TestStampPattern-1520710234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-9e04905c-e7c5-4527-ace2-52e36d1e20c5" returned: 0 in 0.683s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e02eec8a-65de-4d56-94ba-8e58bdd1d4b1 tempest-TestStampPattern-1520710234 None] Lock "cinder-quobyte-9e04905c-e7c5-4527-ace2-52e36d1e20c5" released by "delete_volume" :: held 2.101s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:12:59 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-e02eec8a-65de-4d56-94ba-8e58bdd1d4b1 tempest-TestStampPattern-1520710234 None] Created reservations ['fc0c6c33-54ee-4c13-abb8-c48540ab9fc1', 'bc38101b-f75d-41f4-9a3a-8948a6c496da', '443100e6-73b7-4285-a3d9-65b4c4762cac', '6077f983-0ceb-4c12-9edd-7fb90a494929'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:12:59 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Jul 09 10:12:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb55e647-2011-40c3-97f4-46761a1be69c tempest-SnapshotDependencyTests-1009740048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.info" returned: 0 in 0.767s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:12:59 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-eb55e647-2011-40c3-97f4-46761a1be69c tempest-SnapshotDependencyTests-1009740048 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.info is being set with open permissions: ugo+rw Jul 09 10:12:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb55e647-2011-40c3-97f4-46761a1be69c tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e02eec8a-65de-4d56-94ba-8e58bdd1d4b1 tempest-TestStampPattern-1520710234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:12:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e02eec8a-65de-4d56-94ba-8e58bdd1d4b1 tempest-TestStampPattern-1520710234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:12:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e02eec8a-65de-4d56-94ba-8e58bdd1d4b1 tempest-TestStampPattern-1520710234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:12:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e02eec8a-65de-4d56-94ba-8e58bdd1d4b1 tempest-TestStampPattern-1520710234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:12:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e02eec8a-65de-4d56-94ba-8e58bdd1d4b1 tempest-TestStampPattern-1520710234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:12:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e02eec8a-65de-4d56-94ba-8e58bdd1d4b1 tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:12:59 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.info Jul 09 10:12:59 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:12:59 devstack sudo[101513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:12:59 devstack sudo[101513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:00 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-eb55e647-2011-40c3-97f4-46761a1be69c tempest-SnapshotDependencyTests-1009740048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.info" returned: 0 in 0.661s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-eb55e647-2011-40c3-97f4-46761a1be69c tempest-SnapshotDependencyTests-1009740048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.453s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:00 devstack sudo[101513]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.036s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-685395151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf3a2d84-03df-4823-abd9-e6abc3ae1d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dabfd4745104a2995300f9f716ceefc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:56Z,use_quota=True,user_id='d268ef6144954b2a9292b0dcf103c949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Creating volume bf3a2d84-03df-4823-abd9-e6abc3ae1d89 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:13:00 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bf3a2d84-03df-4823-abd9-e6abc3ae1d89 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e02eec8a-65de-4d56-94ba-8e58bdd1d4b1 tempest-TestStampPattern-1520710234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.683s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-e02eec8a-65de-4d56-94ba-8e58bdd1d4b1 tempest-TestStampPattern-1520710234 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:13:00 devstack sudo[101518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bf3a2d84-03df-4823-abd9-e6abc3ae1d89 1073741824 Jul 09 10:13:00 devstack sudo[101518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e02eec8a-65de-4d56-94ba-8e58bdd1d4b1 tempest-TestStampPattern-1520710234 None] Deleted volume successfully. Jul 09 10:13:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-eb55e647-2011-40c3-97f4-46761a1be69c tempest-SnapshotDependencyTests-1009740048 None] Create snapshot completed successfully Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e02eec8a-65de-4d56-94ba-8e58bdd1d4b1 tempest-TestStampPattern-1520710234 None] Lock "cinder-9e04905c-e7c5-4527-ace2-52e36d1e20c5-delete_volume" released by "delete_volume" :: held 3.065s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] Acquiring lock "cinder-ed245bc6-79c2-49e5-97a2-fed87f4ff1f0-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] Lock "cinder-ed245bc6-79c2-49e5-97a2-fed87f4ff1f0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] Acquiring lock "cinder-quobyte-e4d9b5a5-005a-470f-a250-a3efb99964b0" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] Lock "cinder-quobyte-e4d9b5a5-005a-470f-a250-a3efb99964b0" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] Acquiring lock "cinder-quobyte-ed245bc6-79c2-49e5-97a2-fed87f4ff1f0" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] Lock "cinder-quobyte-ed245bc6-79c2-49e5-97a2-fed87f4ff1f0" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] Deleting offline snapshot ed245bc6-79c2-49e5-97a2-fed87f4ff1f0 of volume e4d9b5a5-005a-470f-a250-a3efb99964b0 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] snapshot_file for this snap is: volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7668e5-e53a-42e2-98c9-addd6913b047]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:00 devstack sudo[101523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0 Jul 09 10:13:00 devstack sudo[101523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:01 devstack sudo[101518]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bf3a2d84-03df-4823-abd9-e6abc3ae1d89 1073741824" returned: 0 in 0.860s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bf3a2d84-03df-4823-abd9-e6abc3ae1d89 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:01 devstack sudo[101526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bf3a2d84-03df-4823-abd9-e6abc3ae1d89 Jul 09 10:13:01 devstack sudo[101526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:01 devstack sudo[101523]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0" returned: 0 in 0.810s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e4d9b5a5-005a-470f-a250-a3efb99964b0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cc6bf9-ddca-483a-8b23-a304c586fdc9]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:01 devstack sudo[101526]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bf3a2d84-03df-4823-abd9-e6abc3ae1d89" returned: 0 in 0.688s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] <== create_volume: return (1587ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.203s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1368322038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=403deda2-b534-4c35-ad64-da4efaf533bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dabfd4745104a2995300f9f716ceefc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:56Z,use_quota=True,user_id='d268ef6144954b2a9292b0dcf103c949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Creating volume 403deda2-b534-4c35-ad64-da4efaf533bd {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:13:01 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-403deda2-b534-4c35-ad64-da4efaf533bd 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ea8e94f-cc02-4712-8719-174a752383dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf3a2d84-03df-4823-abd9-e6abc3ae1d89', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789328f9-314b-4db1-a569-2add3387bafe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:13:01 devstack sudo[101533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-403deda2-b534-4c35-ad64-da4efaf533bd 1073741824 Jul 09 10:13:01 devstack sudo[101533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:01 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Volume volume-bf3a2d84-03df-4823-abd9-e6abc3ae1d89 (bf3a2d84-03df-4823-abd9-e6abc3ae1d89): created successfully Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (789328f9-314b-4db1-a569-2add3387bafe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Flow 'volume_create_manager' (2ec94e14-af42-4d43-aa4b-c844afe08dca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:13:01 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d7f4552c-1efc-4459-9616-ae30d2c93b25 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Created volume successfully. Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:13:01 devstack sudo[101532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 Jul 09 10:13:01 devstack sudo[101532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Flow 'volume_create_manager' (e8e96d6e-96ad-4c01-b0bf-0092a195bdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8babb65-2f1e-41d8-a462-6ff76806dcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8babb65-2f1e-41d8-a462-6ff76806dcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:13:01Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a87bc032-fb41-4a47-9815-94e349eb5b7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3fe361d8b7dd40dabfe7d38a0f459e6a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:13:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:13:02Z,use_quota=True,user_id='6f30c620b2b1402ba8e3f4cf0c64580f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748abad6-e97e-4011-aec4-d5c3f1325c54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (748abad6-e97e-4011-aec4-d5c3f1325c54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c57207-5f6f-4d49-a8ff-58cf0d389750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c57207-5f6f-4d49-a8ff-58cf0d389750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'a87bc032-fb41-4a47-9815-94e349eb5b7d', 'volume_name': 'volume-a87bc032-fb41-4a47-9815-94e349eb5b7d', 'volume_size': 1, 'snapshot_id': '52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff01b73f-e107-4e83-8d46-7b31588c95ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ff01b73f-e107-4e83-8d46-7b31588c95ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4895326-d821-4520-97c5-c4e92c11cebc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:13:01 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Volume a87bc032-fb41-4a47-9815-94e349eb5b7d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-a87bc032-fb41-4a47-9815-94e349eb5b7d', 'volume_size': 1, 'snapshot_id': '52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1'} Jul 09 10:13:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:02 devstack sudo[101532]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0" returned: 0 in 0.856s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:02 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0 Jul 09 10:13:02 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:02 devstack sudo[101533]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-403deda2-b534-4c35-ad64-da4efaf533bd 1073741824" returned: 0 in 0.896s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-403deda2-b534-4c35-ad64-da4efaf533bd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:02 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-403deda2-b534-4c35-ad64-da4efaf533bd Jul 09 10:13:02 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:03 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0" returned: 0 in 0.726s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:03 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0 Jul 09 10:13:03 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:03 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-403deda2-b534-4c35-ad64-da4efaf533bd" returned: 0 in 0.661s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] <== create_volume: return (1635ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.637s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.268s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-899450391',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5a4fc5a-e108-4d0a-9fab-88effe04c756,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dabfd4745104a2995300f9f716ceefc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:57Z,use_quota=True,user_id='d268ef6144954b2a9292b0dcf103c949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Creating volume b5a4fc5a-e108-4d0a-9fab-88effe04c756 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:13:03 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b5a4fc5a-e108-4d0a-9fab-88effe04c756 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2179d55-d315-405a-8a6f-cef01f6983be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-403deda2-b534-4c35-ad64-da4efaf533bd', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:03 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b5a4fc5a-e108-4d0a-9fab-88effe04c756 1073741824 Jul 09 10:13:03 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990cf8ce-0394-435b-8444-6e4425c97e31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:13:03 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Volume volume-403deda2-b534-4c35-ad64-da4efaf533bd (403deda2-b534-4c35-ad64-da4efaf533bd): created successfully Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990cf8ce-0394-435b-8444-6e4425c97e31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Flow 'volume_create_manager' (b7fa50bc-e119-47a8-a208-b59875ca381d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:13:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b0f20183-f9e2-4517-bf9b-17bd1001755e tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Created volume successfully. Jul 09 10:13:03 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0.ed245bc6-79c2-49e5-97a2-fed87f4ff1f0" returned: 0 in 0.668s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] Lock "cinder-quobyte-ed245bc6-79c2-49e5-97a2-fed87f4ff1f0" released by "_delete_snapshot" :: held 3.172s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] Lock "cinder-quobyte-e4d9b5a5-005a-470f-a250-a3efb99964b0" released by "delete_snapshot" :: held 3.194s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:04 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] Created reservations ['3daa47c0-d2c5-49da-8e93-ef47cf295300', '4c780d3f-96b8-4ad6-b17c-1f83ed7ed424', 'a504b1ab-0eed-45e8-8af5-47cc143e4599', 'b15a3f95-4de7-4fbc-8f0c-9583638b2188'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:13:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] Delete snapshot completed successfully. Jul 09 10:13:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f95f5849-4c15-4a5f-9a4c-c4bccd5092ab tempest-TestStampPattern-1520710234 None] Lock "cinder-ed245bc6-79c2-49e5-97a2-fed87f4ff1f0-delete_snapshot" released by "delete_snapshot" :: held 3.343s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:04 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b5a4fc5a-e108-4d0a-9fab-88effe04c756 1073741824" returned: 0 in 0.870s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b5a4fc5a-e108-4d0a-9fab-88effe04c756 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:04 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b5a4fc5a-e108-4d0a-9fab-88effe04c756 Jul 09 10:13:04 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:04 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b5a4fc5a-e108-4d0a-9fab-88effe04c756" returned: 0 in 0.662s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] <== create_volume: return (1586ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:13:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.234s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-206088351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f4d0915-00ce-460d-b374-9108a3789da6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dabfd4745104a2995300f9f716ceefc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:57Z,use_quota=True,user_id='d268ef6144954b2a9292b0dcf103c949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:13:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Creating volume 1f4d0915-00ce-460d-b374-9108a3789da6 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:13:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:13:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:13:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:13:04 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:13:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f4d0915-00ce-460d-b374-9108a3789da6 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:05 devstack sudo[101565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f4d0915-00ce-460d-b374-9108a3789da6 1073741824 Jul 09 10:13:05 devstack sudo[101565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a4c79b-0fa6-42f3-b735-97cdcec8b96b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5a4fc5a-e108-4d0a-9fab-88effe04c756', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d957dd52-a7f6-467e-8b5c-585b58d85fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:13:05 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Volume volume-b5a4fc5a-e108-4d0a-9fab-88effe04c756 (b5a4fc5a-e108-4d0a-9fab-88effe04c756): created successfully Jul 09 10:13:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d957dd52-a7f6-467e-8b5c-585b58d85fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Flow 'volume_create_manager' (f59d2d2e-c6b4-4c15-86e0-d6cd6340c610) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:13:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f0a61fde-d2ea-4f42-ae97-e1302c2ac033 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Created volume successfully. Jul 09 10:13:05 devstack sudo[101565]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f4d0915-00ce-460d-b374-9108a3789da6 1073741824" returned: 0 in 0.913s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f4d0915-00ce-460d-b374-9108a3789da6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:05 devstack sudo[101573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f4d0915-00ce-460d-b374-9108a3789da6 Jul 09 10:13:05 devstack sudo[101573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:06 devstack sudo[101573]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f4d0915-00ce-460d-b374-9108a3789da6" returned: 0 in 0.655s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:13:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.249s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1144578724',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2dabfd4745104a2995300f9f716ceefc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:58Z,use_quota=True,user_id='d268ef6144954b2a9292b0dcf103c949',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:13:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Creating volume 75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:13:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:13:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:13:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:13:06 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:13:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:06 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95 1073741824 Jul 09 10:13:06 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08dde7a8-b76d-4cc0-a4fb-282c8b88a917) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f4d0915-00ce-460d-b374-9108a3789da6', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c79e0e-98c6-4590-a455-2e078db34ce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:13:06 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Volume volume-1f4d0915-00ce-460d-b374-9108a3789da6 (1f4d0915-00ce-460d-b374-9108a3789da6): created successfully Jul 09 10:13:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18c79e0e-98c6-4590-a455-2e078db34ce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Flow 'volume_create_manager' (6d4a43ac-e8db-4cf8-99eb-53a60b80d236) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:13:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c5ae6c05-9b29-4789-a2ac-7a96fbfb0a30 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Created volume successfully. Jul 09 10:13:07 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95 1073741824" returned: 0 in 0.867s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:07 devstack sudo[101589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95 Jul 09 10:13:07 devstack sudo[101589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:08 devstack sudo[101589]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95" returned: 0 in 0.806s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] <== create_volume: return (1714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:13:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.717s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.271s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-220426449',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149c9a9d-da68-4042-8cd2-d6ce95819c49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3f1e71f47be14fd8bc6a5078ca667635',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:12:59Z,use_quota=True,user_id='6054c3af39b14f0f867bd7612ee12856',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:13:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Creating volume 149c9a9d-da68-4042-8cd2-d6ce95819c49 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:13:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:13:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:13:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:13:08 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:13:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b249b711-99bf-4bbb-a656-125159232c5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f2d624-69f9-46cf-9271-822d9d4c08fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:13:08 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 1073741824 Jul 09 10:13:08 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Volume volume-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95 (75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95): created successfully Jul 09 10:13:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77f2d624-69f9-46cf-9271-822d9d4c08fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Flow 'volume_create_manager' (71ee4cc6-c715-4d4c-951d-3a2992708f11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:13:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d41ab92a-dcb2-46b6-b2b9-86041452de48 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Created volume successfully. Jul 09 10:13:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f8f5c7be-eae1-4684-ab99-8928e70a10d0 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "cinder-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f8f5c7be-eae1-4684-ab99-8928e70a10d0 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f8f5c7be-eae1-4684-ab99-8928e70a10d0 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "cinder-quobyte-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f8f5c7be-eae1-4684-ab99-8928e70a10d0 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-quobyte-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:09 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[82842fb4-76a8-42fa-b6bd-3f08cb55d9e6]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f8f5c7be-eae1-4684-ab99-8928e70a10d0 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:09 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95 Jul 09 10:13:09 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:09 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 1073741824" returned: 0 in 0.983s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:09 devstack sudo[101620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 Jul 09 10:13:09 devstack sudo[101620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:09 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f8f5c7be-eae1-4684-ab99-8928e70a10d0 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95" returned: 0 in 0.783s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f8f5c7be-eae1-4684-ab99-8928e70a10d0 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:09 devstack sudo[101626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95 Jul 09 10:13:09 devstack sudo[101626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:10 devstack sudo[101620]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49" returned: 0 in 0.674s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] <== create_volume: return (1699ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.703s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 8.061s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Acquiring lock "cinder-quobyte-52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1-a87bc032-fb41-4a47-9815-94e349eb5b7d" by "_create_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Lock "cinder-quobyte-52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1-a87bc032-fb41-4a47-9815-94e349eb5b7d" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Creating volume a87bc032-fb41-4a47-9815-94e349eb5b7d from snapshot 52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1 {{(pid=87192) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Acquiring lock "cinder-quobyte-a87bc032-fb41-4a47-9815-94e349eb5b7d" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c31bdd5c-115c-4824-9c01-1db1cc353c6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-149c9a9d-da68-4042-8cd2-d6ce95819c49', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8b0d1f-352d-467b-af4c-4988fdd372a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:13:10 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Volume volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 (149c9a9d-da68-4042-8cd2-d6ce95819c49): created successfully Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be8b0d1f-352d-467b-af4c-4988fdd372a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Flow 'volume_create_manager' (896aa508-c2e1-4261-8698-fa44009c4565) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Lock "cinder-quobyte-a87bc032-fb41-4a47-9815-94e349eb5b7d" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] snapshot: 52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1, volume: a87bc032-fb41-4a47-9815-94e349eb5b7d, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:10 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3c91e10d-6f7c-4b1a-8dd4-de5b06980c10 tempest-VolumesActionsTest-1158003976 None] Created volume successfully. Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[87d6d958-b514-4167-b1d2-96ab962bc69a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:10 devstack sudo[101628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1 Jul 09 10:13:10 devstack sudo[101628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:10 devstack sudo[101626]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f8f5c7be-eae1-4684-ab99-8928e70a10d0 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95" returned: 0 in 0.776s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f8f5c7be-eae1-4684-ab99-8928e70a10d0 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-quobyte-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95" released by "delete_volume" :: held 1.604s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-f8f5c7be-eae1-4684-ab99-8928e70a10d0 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Created reservations ['73fbe833-ebd1-43f5-9d4c-47c09b1258f9', '49d54bdf-8664-4235-bf81-31ebb60e460a', '31e692b9-b4b0-488d-a56b-c75a5314cc3d', 'e478c31a-9418-4c1d-a760-36b541c2e858'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f8f5c7be-eae1-4684-ab99-8928e70a10d0 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f8f5c7be-eae1-4684-ab99-8928e70a10d0 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f8f5c7be-eae1-4684-ab99-8928e70a10d0 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f8f5c7be-eae1-4684-ab99-8928e70a10d0 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f8f5c7be-eae1-4684-ab99-8928e70a10d0 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f8f5c7be-eae1-4684-ab99-8928e70a10d0 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:10 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:13:10 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:11 devstack sudo[101628]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1" returned: 0 in 0.863s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-130be66f-b609-4335-b953-2eb77ebc833c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:13:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 10:13:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 10:13:11 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d4e6140-a870-4467-ab11-d30f6c32592b]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:11 devstack sudo[101636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c Jul 09 10:13:11 devstack sudo[101636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-be04a8b6-f337-4709-872f-02fd15fe6965 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "cinder-1f4d0915-00ce-460d-b374-9108a3789da6-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-be04a8b6-f337-4709-872f-02fd15fe6965 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-1f4d0915-00ce-460d-b374-9108a3789da6-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-be04a8b6-f337-4709-872f-02fd15fe6965 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "cinder-quobyte-1f4d0915-00ce-460d-b374-9108a3789da6" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-be04a8b6-f337-4709-872f-02fd15fe6965 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-quobyte-1f4d0915-00ce-460d-b374-9108a3789da6" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:11 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f60edfe5-3647-4858-b238-800d4b5acee1]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be04a8b6-f337-4709-872f-02fd15fe6965 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f4d0915-00ce-460d-b374-9108a3789da6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:11 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f8f5c7be-eae1-4684-ab99-8928e70a10d0 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.801s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:11 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-f8f5c7be-eae1-4684-ab99-8928e70a10d0 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:13:11 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f8f5c7be-eae1-4684-ab99-8928e70a10d0 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Deleted volume successfully. Jul 09 10:13:11 devstack sudo[101639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f4d0915-00ce-460d-b374-9108a3789da6 Jul 09 10:13:11 devstack sudo[101639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f8f5c7be-eae1-4684-ab99-8928e70a10d0 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-75ca7b3f-8b0c-41c6-9473-4f8d8ef4eb95-delete_volume" released by "delete_volume" :: held 2.673s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:12 devstack sudo[101636]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c" returned: 0 in 0.991s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:12 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Path /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a87bc032-fb41-4a47-9815-94e349eb5b7d not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 10:13:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a87bc032-fb41-4a47-9815-94e349eb5b7d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:12 devstack sudo[101647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a87bc032-fb41-4a47-9815-94e349eb5b7d Jul 09 10:13:12 devstack sudo[101647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:12 devstack sudo[101639]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be04a8b6-f337-4709-872f-02fd15fe6965 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f4d0915-00ce-460d-b374-9108a3789da6" returned: 0 in 0.971s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be04a8b6-f337-4709-872f-02fd15fe6965 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f4d0915-00ce-460d-b374-9108a3789da6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c8f86503-33b5-438c-ab0a-8131cc664df1 tempest-TestStampPattern-1520710234 None] Acquiring lock "cinder-e4d9b5a5-005a-470f-a250-a3efb99964b0-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:12 devstack sudo[101652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f4d0915-00ce-460d-b374-9108a3789da6 Jul 09 10:13:12 devstack sudo[101652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c8f86503-33b5-438c-ab0a-8131cc664df1 tempest-TestStampPattern-1520710234 None] Lock "cinder-e4d9b5a5-005a-470f-a250-a3efb99964b0-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c8f86503-33b5-438c-ab0a-8131cc664df1 tempest-TestStampPattern-1520710234 None] Acquiring lock "cinder-quobyte-e4d9b5a5-005a-470f-a250-a3efb99964b0" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c8f86503-33b5-438c-ab0a-8131cc664df1 tempest-TestStampPattern-1520710234 None] Lock "cinder-quobyte-e4d9b5a5-005a-470f-a250-a3efb99964b0" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:12 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[804bd05c-8f81-4cb1-a324-572d0b7bb69e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8f86503-33b5-438c-ab0a-8131cc664df1 tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:12 devstack sudo[101657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 Jul 09 10:13:12 devstack sudo[101657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:14 devstack sudo[101652]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be04a8b6-f337-4709-872f-02fd15fe6965 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f4d0915-00ce-460d-b374-9108a3789da6" returned: 0 in 1.613s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-be04a8b6-f337-4709-872f-02fd15fe6965 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-quobyte-1f4d0915-00ce-460d-b374-9108a3789da6" released by "delete_volume" :: held 2.679s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:14 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-be04a8b6-f337-4709-872f-02fd15fe6965 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Created reservations ['51717651-8004-4686-9018-eb7e357cb8c7', 'a0951ab1-8f4f-4590-b3f5-2270e95c8105', '6d4a48f5-ed2d-445a-b3a5-543b9d9b640b', '303bf92c-0e79-4ff2-bb14-7bbd4b7393b3'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:13:14 devstack sudo[101657]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8f86503-33b5-438c-ab0a-8131cc664df1 tempest-TestStampPattern-1520710234 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0" returned: 0 in 1.697s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8f86503-33b5-438c-ab0a-8131cc664df1 tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:14 devstack sudo[101670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0 Jul 09 10:13:14 devstack sudo[101670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-be04a8b6-f337-4709-872f-02fd15fe6965 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-be04a8b6-f337-4709-872f-02fd15fe6965 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-be04a8b6-f337-4709-872f-02fd15fe6965 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:13:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-be04a8b6-f337-4709-872f-02fd15fe6965 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:13:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-be04a8b6-f337-4709-872f-02fd15fe6965 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be04a8b6-f337-4709-872f-02fd15fe6965 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:14 devstack sudo[101673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:13:14 devstack sudo[101673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-071b16ba-35d9-4ff3-8a42-8fdbcd137c10 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "cinder-b5a4fc5a-e108-4d0a-9fab-88effe04c756-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-071b16ba-35d9-4ff3-8a42-8fdbcd137c10 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-b5a4fc5a-e108-4d0a-9fab-88effe04c756-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-071b16ba-35d9-4ff3-8a42-8fdbcd137c10 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "cinder-quobyte-b5a4fc5a-e108-4d0a-9fab-88effe04c756" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-071b16ba-35d9-4ff3-8a42-8fdbcd137c10 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-quobyte-b5a4fc5a-e108-4d0a-9fab-88effe04c756" acquired by "delete_volume" :: waited 0.048s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:15 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c179e9bf-4f08-44ec-b471-a974e8a14b19]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-071b16ba-35d9-4ff3-8a42-8fdbcd137c10 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b5a4fc5a-e108-4d0a-9fab-88effe04c756 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:15 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b5a4fc5a-e108-4d0a-9fab-88effe04c756 Jul 09 10:13:15 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:15 devstack sudo[101673]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be04a8b6-f337-4709-872f-02fd15fe6965 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.438s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:16 devstack sudo[101670]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:16 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-be04a8b6-f337-4709-872f-02fd15fe6965 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:13:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8f86503-33b5-438c-ab0a-8131cc664df1 tempest-TestStampPattern-1520710234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e4d9b5a5-005a-470f-a250-a3efb99964b0" returned: 0 in 1.635s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:16 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-be04a8b6-f337-4709-872f-02fd15fe6965 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Deleted volume successfully. Jul 09 10:13:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c8f86503-33b5-438c-ab0a-8131cc664df1 tempest-TestStampPattern-1520710234 None] Lock "cinder-quobyte-e4d9b5a5-005a-470f-a250-a3efb99964b0" released by "delete_volume" :: held 3.449s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-be04a8b6-f337-4709-872f-02fd15fe6965 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-1f4d0915-00ce-460d-b374-9108a3789da6-delete_volume" released by "delete_volume" :: held 4.748s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:16 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c8f86503-33b5-438c-ab0a-8131cc664df1 tempest-TestStampPattern-1520710234 None] Created reservations ['7cb1c96a-38d4-4116-8241-2725a131dc78', 'b4721b11-4ea9-457f-be2e-bc3489b6c35b', '8df91a12-290b-4659-a4ad-d030cb61848a', 'ef10cecf-8c27-404d-ae5c-dc079ce6e6ff'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:13:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c8f86503-33b5-438c-ab0a-8131cc664df1 tempest-TestStampPattern-1520710234 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c8f86503-33b5-438c-ab0a-8131cc664df1 tempest-TestStampPattern-1520710234 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c8f86503-33b5-438c-ab0a-8131cc664df1 tempest-TestStampPattern-1520710234 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:13:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c8f86503-33b5-438c-ab0a-8131cc664df1 tempest-TestStampPattern-1520710234 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:13:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c8f86503-33b5-438c-ab0a-8131cc664df1 tempest-TestStampPattern-1520710234 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8f86503-33b5-438c-ab0a-8131cc664df1 tempest-TestStampPattern-1520710234 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:16 devstack sudo[101679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:13:16 devstack sudo[101679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:17 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-071b16ba-35d9-4ff3-8a42-8fdbcd137c10 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b5a4fc5a-e108-4d0a-9fab-88effe04c756" returned: 0 in 2.412s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-071b16ba-35d9-4ff3-8a42-8fdbcd137c10 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b5a4fc5a-e108-4d0a-9fab-88effe04c756 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:17 devstack sudo[101685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b5a4fc5a-e108-4d0a-9fab-88effe04c756 Jul 09 10:13:17 devstack sudo[101685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:18 devstack sudo[101679]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c8f86503-33b5-438c-ab0a-8131cc664df1 tempest-TestStampPattern-1520710234 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.696s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:18 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-c8f86503-33b5-438c-ab0a-8131cc664df1 tempest-TestStampPattern-1520710234 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:13:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c8f86503-33b5-438c-ab0a-8131cc664df1 tempest-TestStampPattern-1520710234 None] Deleted volume successfully. Jul 09 10:13:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c8f86503-33b5-438c-ab0a-8131cc664df1 tempest-TestStampPattern-1520710234 None] Lock "cinder-e4d9b5a5-005a-470f-a250-a3efb99964b0-delete_volume" released by "delete_volume" :: held 5.759s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:18 devstack sudo[101647]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a87bc032-fb41-4a47-9815-94e349eb5b7d" returned: 0 in 6.808s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:18 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[70965ded-072e-490f-9c55-9a26c948a4fd]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:19 devstack sudo[101693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c Jul 09 10:13:19 devstack sudo[101693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:19 devstack sudo[101685]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-071b16ba-35d9-4ff3-8a42-8fdbcd137c10 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b5a4fc5a-e108-4d0a-9fab-88effe04c756" returned: 0 in 1.424s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-071b16ba-35d9-4ff3-8a42-8fdbcd137c10 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-quobyte-b5a4fc5a-e108-4d0a-9fab-88effe04c756" released by "delete_volume" :: held 3.926s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:19 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-071b16ba-35d9-4ff3-8a42-8fdbcd137c10 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Created reservations ['8f988d83-d09a-49f5-b7bb-c7b05c84ffaf', '8dee5e28-abb9-47fb-8ec8-49d3de440377', 'd56ccd80-585a-4270-b734-bad982e5730c', '78ab1c2f-5b36-4a0d-97f7-af1f12018655'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:13:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-071b16ba-35d9-4ff3-8a42-8fdbcd137c10 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-071b16ba-35d9-4ff3-8a42-8fdbcd137c10 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-071b16ba-35d9-4ff3-8a42-8fdbcd137c10 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:13:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-071b16ba-35d9-4ff3-8a42-8fdbcd137c10 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:13:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-071b16ba-35d9-4ff3-8a42-8fdbcd137c10 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-071b16ba-35d9-4ff3-8a42-8fdbcd137c10 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:19 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:13:19 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89d5f66f-aee6-4a90-927f-51fa05195a0a tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "cinder-403deda2-b534-4c35-ad64-da4efaf533bd-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89d5f66f-aee6-4a90-927f-51fa05195a0a tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-403deda2-b534-4c35-ad64-da4efaf533bd-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89d5f66f-aee6-4a90-927f-51fa05195a0a tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "cinder-quobyte-403deda2-b534-4c35-ad64-da4efaf533bd" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89d5f66f-aee6-4a90-927f-51fa05195a0a tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-quobyte-403deda2-b534-4c35-ad64-da4efaf533bd" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:20 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[abdf84ca-6379-4618-bf3f-98f8f3a799fc]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-89d5f66f-aee6-4a90-927f-51fa05195a0a tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-403deda2-b534-4c35-ad64-da4efaf533bd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:20 devstack sudo[101713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-403deda2-b534-4c35-ad64-da4efaf533bd Jul 09 10:13:20 devstack sudo[101713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:20 devstack sudo[101693]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c" returned: 0 in 1.528s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:20 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Image conversion details: src /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c, size 1024.00 MB, duration 6.81 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a87bc032-fb41-4a47-9815-94e349eb5b7d {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:13:20 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Converted 1024.00 MB image at 150.38 MB/s Jul 09 10:13:20 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a87bc032-fb41-4a47-9815-94e349eb5b7d is being set with open permissions: ugo+rw Jul 09 10:13:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a87bc032-fb41-4a47-9815-94e349eb5b7d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:20 devstack sudo[101717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a87bc032-fb41-4a47-9815-94e349eb5b7d Jul 09 10:13:20 devstack sudo[101717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:20 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-071b16ba-35d9-4ff3-8a42-8fdbcd137c10 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.091s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:20 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-071b16ba-35d9-4ff3-8a42-8fdbcd137c10 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:13:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-071b16ba-35d9-4ff3-8a42-8fdbcd137c10 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Deleted volume successfully. Jul 09 10:13:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-071b16ba-35d9-4ff3-8a42-8fdbcd137c10 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-b5a4fc5a-e108-4d0a-9fab-88effe04c756-delete_volume" released by "delete_volume" :: held 5.529s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:21 devstack sudo[101713]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-89d5f66f-aee6-4a90-927f-51fa05195a0a tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-403deda2-b534-4c35-ad64-da4efaf533bd" returned: 0 in 1.092s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-89d5f66f-aee6-4a90-927f-51fa05195a0a tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-403deda2-b534-4c35-ad64-da4efaf533bd {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:21 devstack sudo[101724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-403deda2-b534-4c35-ad64-da4efaf533bd Jul 09 10:13:21 devstack sudo[101724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:21 devstack sudo[101717]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a87bc032-fb41-4a47-9815-94e349eb5b7d" returned: 0 in 0.887s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Lock "cinder-quobyte-a87bc032-fb41-4a47-9815-94e349eb5b7d" released by "_copy_volume_from_snapshot" :: held 11.209s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Lock "cinder-quobyte-52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1-a87bc032-fb41-4a47-9815-94e349eb5b7d" released by "_create_volume_from_snapshot" :: held 11.279s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.303s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4895326-d821-4520-97c5-c4e92c11cebc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a87bc032-fb41-4a47-9815-94e349eb5b7d', 'volume_size': 1, 'snapshot_id': '52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fcf781-8be1-452d-89cb-5589d260e325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:13:21 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Volume volume-a87bc032-fb41-4a47-9815-94e349eb5b7d (a87bc032-fb41-4a47-9815-94e349eb5b7d): created successfully Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55fcf781-8be1-452d-89cb-5589d260e325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Flow 'volume_create_manager' (e8e96d6e-96ad-4c01-b0bf-0092a195bdca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:13:21 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-09bb83e9-dd91-4825-a25f-603b4823c6a4 tempest-SnapshotDependencyTests-1009740048 None] Created volume successfully. Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] Acquiring lock "cinder-52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] Lock "cinder-52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] Acquiring lock "cinder-quobyte-130be66f-b609-4335-b953-2eb77ebc833c" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] Lock "cinder-quobyte-130be66f-b609-4335-b953-2eb77ebc833c" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] Acquiring lock "cinder-quobyte-52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] Lock "cinder-quobyte-52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] Deleting offline snapshot 52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1 of volume 130be66f-b609-4335-b953-2eb77ebc833c {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] snapshot_file for this snap is: volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:13:21 devstack sudo[101724]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-89d5f66f-aee6-4a90-927f-51fa05195a0a tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-403deda2-b534-4c35-ad64-da4efaf533bd" returned: 0 in 0.718s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca469cd3-dc71-4629-8388-5b49424d6c92]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89d5f66f-aee6-4a90-927f-51fa05195a0a tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-quobyte-403deda2-b534-4c35-ad64-da4efaf533bd" released by "delete_volume" :: held 1.862s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:21 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-89d5f66f-aee6-4a90-927f-51fa05195a0a tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Created reservations ['cad8b702-c8a6-4cc0-b91c-bdd13de4b40c', 'd57cb406-dcb7-4e75-b6b3-46fe82946564', '30ec3899-1bb8-47f6-8e95-b8bdff915e8c', 'e956f050-dd3b-4ed2-9aa4-3a42d905bddb'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:13:22 devstack sudo[101728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1 Jul 09 10:13:22 devstack sudo[101728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-89d5f66f-aee6-4a90-927f-51fa05195a0a tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-89d5f66f-aee6-4a90-927f-51fa05195a0a tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-89d5f66f-aee6-4a90-927f-51fa05195a0a tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:13:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-89d5f66f-aee6-4a90-927f-51fa05195a0a tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:13:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-89d5f66f-aee6-4a90-927f-51fa05195a0a tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-89d5f66f-aee6-4a90-927f-51fa05195a0a tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:22 devstack sudo[101730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:13:22 devstack sudo[101730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4694b14b-2f19-4d48-86fc-8809928ac3e8 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "cinder-bf3a2d84-03df-4823-abd9-e6abc3ae1d89-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4694b14b-2f19-4d48-86fc-8809928ac3e8 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-bf3a2d84-03df-4823-abd9-e6abc3ae1d89-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4694b14b-2f19-4d48-86fc-8809928ac3e8 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "cinder-quobyte-bf3a2d84-03df-4823-abd9-e6abc3ae1d89" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4694b14b-2f19-4d48-86fc-8809928ac3e8 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-quobyte-bf3a2d84-03df-4823-abd9-e6abc3ae1d89" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c0e9243-5bef-4021-b2d1-913d259715d3]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4694b14b-2f19-4d48-86fc-8809928ac3e8 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bf3a2d84-03df-4823-abd9-e6abc3ae1d89 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:22 devstack sudo[101732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bf3a2d84-03df-4823-abd9-e6abc3ae1d89 Jul 09 10:13:22 devstack sudo[101732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:23 devstack sudo[101728]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1" returned: 0 in 1.176s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-130be66f-b609-4335-b953-2eb77ebc833c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:13:23 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[93f7101b-1a56-4fe6-9f10-5f949149b7b9]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:23 devstack sudo[101730]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-89d5f66f-aee6-4a90-927f-51fa05195a0a tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.102s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:23 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-89d5f66f-aee6-4a90-927f-51fa05195a0a tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:13:23 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-89d5f66f-aee6-4a90-927f-51fa05195a0a tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Deleted volume successfully. Jul 09 10:13:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-89d5f66f-aee6-4a90-927f-51fa05195a0a tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-403deda2-b534-4c35-ad64-da4efaf533bd-delete_volume" released by "delete_volume" :: held 3.246s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:23 devstack sudo[101738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c Jul 09 10:13:23 devstack sudo[101738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:23 devstack sudo[101732]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4694b14b-2f19-4d48-86fc-8809928ac3e8 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bf3a2d84-03df-4823-abd9-e6abc3ae1d89" returned: 0 in 1.140s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4694b14b-2f19-4d48-86fc-8809928ac3e8 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bf3a2d84-03df-4823-abd9-e6abc3ae1d89 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:23 devstack sudo[101744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bf3a2d84-03df-4823-abd9-e6abc3ae1d89 Jul 09 10:13:23 devstack sudo[101744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:24 devstack sudo[101738]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c" returned: 0 in 0.962s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:24 devstack sudo[101749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1 Jul 09 10:13:24 devstack sudo[101749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:24 devstack sudo[101744]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4694b14b-2f19-4d48-86fc-8809928ac3e8 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bf3a2d84-03df-4823-abd9-e6abc3ae1d89" returned: 0 in 0.872s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4694b14b-2f19-4d48-86fc-8809928ac3e8 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-quobyte-bf3a2d84-03df-4823-abd9-e6abc3ae1d89" released by "delete_volume" :: held 2.110s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:24 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-4694b14b-2f19-4d48-86fc-8809928ac3e8 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Created reservations ['148f5e20-01bd-4c28-b897-2c8dc9653d9b', '11f2941d-e1d2-425e-a40f-c8fe2bb559eb', '1f4c18cc-5842-4fdf-a1d5-fd350a7461d5', 'bd2a55b0-9d0a-487e-bd60-7c47896889c8'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:13:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4694b14b-2f19-4d48-86fc-8809928ac3e8 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4694b14b-2f19-4d48-86fc-8809928ac3e8 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4694b14b-2f19-4d48-86fc-8809928ac3e8 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:13:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4694b14b-2f19-4d48-86fc-8809928ac3e8 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:13:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4694b14b-2f19-4d48-86fc-8809928ac3e8 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4694b14b-2f19-4d48-86fc-8809928ac3e8 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:24 devstack sudo[101785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:13:24 devstack sudo[101785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:25 devstack sudo[101749]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1" returned: 0 in 1.284s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:25 devstack sudo[101802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1 Jul 09 10:13:25 devstack sudo[101802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:25 devstack sudo[101785]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4694b14b-2f19-4d48-86fc-8809928ac3e8 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.932s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:25 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-4694b14b-2f19-4d48-86fc-8809928ac3e8 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:13:25 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4694b14b-2f19-4d48-86fc-8809928ac3e8 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Deleted volume successfully. Jul 09 10:13:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46d34483-7c22-43d4-8c06-b4e6dce62b11 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "cinder-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4694b14b-2f19-4d48-86fc-8809928ac3e8 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-bf3a2d84-03df-4823-abd9-e6abc3ae1d89-delete_volume" released by "delete_volume" :: held 3.513s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46d34483-7c22-43d4-8c06-b4e6dce62b11 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46d34483-7c22-43d4-8c06-b4e6dce62b11 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "cinder-quobyte-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46d34483-7c22-43d4-8c06-b4e6dce62b11 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-quobyte-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:25 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[900eee6f-f7fa-4ed3-bdee-d1a338af5b96]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46d34483-7c22-43d4-8c06-b4e6dce62b11 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:26 devstack sudo[101814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1 Jul 09 10:13:26 devstack sudo[101814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:26 devstack sudo[101802]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c.52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1" returned: 0 in 0.809s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] Lock "cinder-quobyte-52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1" released by "_delete_snapshot" :: held 4.409s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] Lock "cinder-quobyte-130be66f-b609-4335-b953-2eb77ebc833c" released by "delete_snapshot" :: held 4.441s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:26 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] Created reservations ['93f7de82-deb5-4d4a-a967-b10a4a434375', '59f4a36c-ac6e-4d43-8db8-9ffb9dcd858b', '80f09a2a-e448-45e3-8a26-880f2ff68810', '7254e3cb-3134-48ca-8e5e-6cb606576778'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:13:26 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] Delete snapshot completed successfully. Jul 09 10:13:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e735635a-8f09-4bfb-a4e3-46e12b19dd4f tempest-SnapshotDependencyTests-1009740048 None] Lock "cinder-52c7f5ae-b4e4-4f75-a961-6bc96ceb07f1-delete_snapshot" released by "delete_snapshot" :: held 4.638s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:26 devstack sudo[101814]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46d34483-7c22-43d4-8c06-b4e6dce62b11 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1" returned: 0 in 1.022s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46d34483-7c22-43d4-8c06-b4e6dce62b11 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:26 devstack sudo[101834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1 Jul 09 10:13:26 devstack sudo[101834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4b465990-250c-46e0-b80e-2fbefcfefb26 tempest-SnapshotDependencyTests-1009740048 None] Acquiring lock "cinder-130be66f-b609-4335-b953-2eb77ebc833c-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4b465990-250c-46e0-b80e-2fbefcfefb26 tempest-SnapshotDependencyTests-1009740048 None] Lock "cinder-130be66f-b609-4335-b953-2eb77ebc833c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4b465990-250c-46e0-b80e-2fbefcfefb26 tempest-SnapshotDependencyTests-1009740048 None] Acquiring lock "cinder-quobyte-130be66f-b609-4335-b953-2eb77ebc833c" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4b465990-250c-46e0-b80e-2fbefcfefb26 tempest-SnapshotDependencyTests-1009740048 None] Lock "cinder-quobyte-130be66f-b609-4335-b953-2eb77ebc833c" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:27 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d46e051-e2ed-490d-bd2e-512992146ef1]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4b465990-250c-46e0-b80e-2fbefcfefb26 tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:27 devstack sudo[101838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c Jul 09 10:13:27 devstack sudo[101838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:28 devstack sudo[101834]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46d34483-7c22-43d4-8c06-b4e6dce62b11 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1" returned: 0 in 1.105s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46d34483-7c22-43d4-8c06-b4e6dce62b11 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-quobyte-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1" released by "delete_volume" :: held 2.214s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:28 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-46d34483-7c22-43d4-8c06-b4e6dce62b11 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Created reservations ['46a311ad-326a-435a-a2cf-4a052ed60d27', '3c89f65c-f5e4-4845-b5d0-da75da8dbfbe', '9103e2a3-c6c7-4713-8255-8a5f3598e839', 'ff8714b2-2074-4a0a-871d-2b8037f13ed5'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:13:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-46d34483-7c22-43d4-8c06-b4e6dce62b11 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-46d34483-7c22-43d4-8c06-b4e6dce62b11 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-46d34483-7c22-43d4-8c06-b4e6dce62b11 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:13:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-46d34483-7c22-43d4-8c06-b4e6dce62b11 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:13:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-46d34483-7c22-43d4-8c06-b4e6dce62b11 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46d34483-7c22-43d4-8c06-b4e6dce62b11 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:28 devstack sudo[101842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:13:28 devstack sudo[101842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:28 devstack sudo[101838]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4b465990-250c-46e0-b80e-2fbefcfefb26 tempest-SnapshotDependencyTests-1009740048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c" returned: 0 in 1.500s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4b465990-250c-46e0-b80e-2fbefcfefb26 tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:28 devstack sudo[101847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c Jul 09 10:13:28 devstack sudo[101847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:29 devstack sudo[101842]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46d34483-7c22-43d4-8c06-b4e6dce62b11 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.010s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:29 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-46d34483-7c22-43d4-8c06-b4e6dce62b11 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:13:29 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-46d34483-7c22-43d4-8c06-b4e6dce62b11 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Deleted volume successfully. Jul 09 10:13:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46d34483-7c22-43d4-8c06-b4e6dce62b11 tempest-CreateVolumesFromSourceVolumeTest-1301511712 None] Lock "cinder-4d2a1c83-2ed6-4f2a-9893-dab3ce9366c1-delete_volume" released by "delete_volume" :: held 3.590s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:13:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:13:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:13:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:29 devstack sudo[101851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:13:29 devstack sudo[101851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:30 devstack sudo[101847]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4b465990-250c-46e0-b80e-2fbefcfefb26 tempest-SnapshotDependencyTests-1009740048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-130be66f-b609-4335-b953-2eb77ebc833c" returned: 0 in 1.229s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4b465990-250c-46e0-b80e-2fbefcfefb26 tempest-SnapshotDependencyTests-1009740048 None] Lock "cinder-quobyte-130be66f-b609-4335-b953-2eb77ebc833c" released by "delete_volume" :: held 2.832s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2fa82f02-cefb-45fc-b24d-7a5272943f89 tempest-VolumesActionsTest-1158003976 None] Acquiring lock "cinder-149c9a9d-da68-4042-8cd2-d6ce95819c49" by "attach_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:30 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-4b465990-250c-46e0-b80e-2fbefcfefb26 tempest-SnapshotDependencyTests-1009740048 None] Created reservations ['2b28ba64-a62c-4d4c-83fb-674f17874995', '4768a0b9-bbf8-452f-a5c9-88498610fc25', '8eb62ed6-3749-4413-b014-79d23ecb60ba', '31c838f9-5fee-43dd-b252-29ab1e745c42'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:13:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2fa82f02-cefb-45fc-b24d-7a5272943f89 tempest-VolumesActionsTest-1158003976 None] Lock "cinder-149c9a9d-da68-4042-8cd2-d6ce95819c49" acquired by "attach_volume" :: waited 0.052s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4b465990-250c-46e0-b80e-2fbefcfefb26 tempest-SnapshotDependencyTests-1009740048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4b465990-250c-46e0-b80e-2fbefcfefb26 tempest-SnapshotDependencyTests-1009740048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4b465990-250c-46e0-b80e-2fbefcfefb26 tempest-SnapshotDependencyTests-1009740048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:13:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-4b465990-250c-46e0-b80e-2fbefcfefb26 tempest-SnapshotDependencyTests-1009740048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:13:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-4b465990-250c-46e0-b80e-2fbefcfefb26 tempest-SnapshotDependencyTests-1009740048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4b465990-250c-46e0-b80e-2fbefcfefb26 tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2fa82f02-cefb-45fc-b24d-7a5272943f89 tempest-VolumesActionsTest-1158003976 None] Attaching volume 149c9a9d-da68-4042-8cd2-d6ce95819c49 to instance af3d6d9b-7d7a-4844-a97a-007134c3c75b at mountpoint /dev/vdb on host None. Jul 09 10:13:30 devstack sudo[101854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:13:30 devstack sudo[101854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2fa82f02-cefb-45fc-b24d-7a5272943f89 tempest-VolumesActionsTest-1158003976 None] Attach volume completed successfully. Jul 09 10:13:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2fa82f02-cefb-45fc-b24d-7a5272943f89 tempest-VolumesActionsTest-1158003976 None] Lock "cinder-149c9a9d-da68-4042-8cd2-d6ce95819c49" released by "attach_volume" :: held 0.152s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3ffe68d-fb70-45af-9454-4036c30e49f7 tempest-SnapshotDependencyTests-1009740048 None] Acquiring lock "cinder-a87bc032-fb41-4a47-9815-94e349eb5b7d-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3ffe68d-fb70-45af-9454-4036c30e49f7 tempest-SnapshotDependencyTests-1009740048 None] Lock "cinder-a87bc032-fb41-4a47-9815-94e349eb5b7d-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3ffe68d-fb70-45af-9454-4036c30e49f7 tempest-SnapshotDependencyTests-1009740048 None] Acquiring lock "cinder-quobyte-a87bc032-fb41-4a47-9815-94e349eb5b7d" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3ffe68d-fb70-45af-9454-4036c30e49f7 tempest-SnapshotDependencyTests-1009740048 None] Lock "cinder-quobyte-a87bc032-fb41-4a47-9815-94e349eb5b7d" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:30 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e89843b-fb29-4e0f-ae6c-1a5119d76e5c]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3ffe68d-fb70-45af-9454-4036c30e49f7 tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a87bc032-fb41-4a47-9815-94e349eb5b7d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-30d1e73b-26f6-4347-ace1-d1800325a987 tempest-VolumesActionsTest-1158003976 None] Acquiring lock "cinder-149c9a9d-da68-4042-8cd2-d6ce95819c49-detach_volume" by "detach_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-30d1e73b-26f6-4347-ace1-d1800325a987 tempest-VolumesActionsTest-1158003976 None] Lock "cinder-149c9a9d-da68-4042-8cd2-d6ce95819c49-detach_volume" acquired by "detach_volume" :: waited 0.050s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:31 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-30d1e73b-26f6-4347-ace1-d1800325a987 tempest-VolumesActionsTest-1158003976 None] Detaching volume 149c9a9d-da68-4042-8cd2-d6ce95819c49 from instance af3d6d9b-7d7a-4844-a97a-007134c3c75b. Jul 09 10:13:31 devstack sudo[101856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a87bc032-fb41-4a47-9815-94e349eb5b7d Jul 09 10:13:31 devstack sudo[101856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:31 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-30d1e73b-26f6-4347-ace1-d1800325a987 tempest-VolumesActionsTest-1158003976 None] Detach volume completed successfully. Jul 09 10:13:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-30d1e73b-26f6-4347-ace1-d1800325a987 tempest-VolumesActionsTest-1158003976 None] Lock "cinder-149c9a9d-da68-4042-8cd2-d6ce95819c49-detach_volume" released by "detach_volume" :: held 0.176s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:31 devstack sudo[101851]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.788s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:31 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:13:31 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:13:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:13:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:13:31 devstack sudo[101854]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-4b465990-250c-46e0-b80e-2fbefcfefb26 tempest-SnapshotDependencyTests-1009740048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.396s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:31 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-4b465990-250c-46e0-b80e-2fbefcfefb26 tempest-SnapshotDependencyTests-1009740048 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:13:31 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-4b465990-250c-46e0-b80e-2fbefcfefb26 tempest-SnapshotDependencyTests-1009740048 None] Deleted volume successfully. Jul 09 10:13:31 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-4b465990-250c-46e0-b80e-2fbefcfefb26 tempest-SnapshotDependencyTests-1009740048 None] Lock "cinder-130be66f-b609-4335-b953-2eb77ebc833c-delete_volume" released by "delete_volume" :: held 4.628s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:32 devstack sudo[101856]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3ffe68d-fb70-45af-9454-4036c30e49f7 tempest-SnapshotDependencyTests-1009740048 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a87bc032-fb41-4a47-9815-94e349eb5b7d" returned: 0 in 1.792s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3ffe68d-fb70-45af-9454-4036c30e49f7 tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a87bc032-fb41-4a47-9815-94e349eb5b7d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:32 devstack sudo[101900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a87bc032-fb41-4a47-9815-94e349eb5b7d Jul 09 10:13:32 devstack sudo[101900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:33 devstack sudo[101900]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3ffe68d-fb70-45af-9454-4036c30e49f7 tempest-SnapshotDependencyTests-1009740048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a87bc032-fb41-4a47-9815-94e349eb5b7d" returned: 0 in 0.754s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3ffe68d-fb70-45af-9454-4036c30e49f7 tempest-SnapshotDependencyTests-1009740048 None] Lock "cinder-quobyte-a87bc032-fb41-4a47-9815-94e349eb5b7d" released by "delete_volume" :: held 2.661s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:33 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a3ffe68d-fb70-45af-9454-4036c30e49f7 tempest-SnapshotDependencyTests-1009740048 None] Created reservations ['2fdfa1e4-ab09-432a-9d1d-380f8a72cadf', 'c1051717-9ad9-4d33-9237-4348ed01e6e0', '33a73435-a301-4f32-9c06-5724e6d62771', '1b16ed2e-2852-47ae-a942-0e1eccb3d0b0'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:13:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a3ffe68d-fb70-45af-9454-4036c30e49f7 tempest-SnapshotDependencyTests-1009740048 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a3ffe68d-fb70-45af-9454-4036c30e49f7 tempest-SnapshotDependencyTests-1009740048 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a3ffe68d-fb70-45af-9454-4036c30e49f7 tempest-SnapshotDependencyTests-1009740048 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:13:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a3ffe68d-fb70-45af-9454-4036c30e49f7 tempest-SnapshotDependencyTests-1009740048 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:13:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a3ffe68d-fb70-45af-9454-4036c30e49f7 tempest-SnapshotDependencyTests-1009740048 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3ffe68d-fb70-45af-9454-4036c30e49f7 tempest-SnapshotDependencyTests-1009740048 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:33 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:13:33 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:34 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3ffe68d-fb70-45af-9454-4036c30e49f7 tempest-SnapshotDependencyTests-1009740048 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.090s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:34 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a3ffe68d-fb70-45af-9454-4036c30e49f7 tempest-SnapshotDependencyTests-1009740048 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:13:34 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a3ffe68d-fb70-45af-9454-4036c30e49f7 tempest-SnapshotDependencyTests-1009740048 None] Deleted volume successfully. Jul 09 10:13:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3ffe68d-fb70-45af-9454-4036c30e49f7 tempest-SnapshotDependencyTests-1009740048 None] Lock "cinder-a87bc032-fb41-4a47-9815-94e349eb5b7d-delete_volume" released by "delete_volume" :: held 4.108s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:40 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:13:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Flow 'volume_create_manager' (c7a0769d-fdfa-4dcf-9cbe-b8419e9387c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:13:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095e45d7-9750-4704-b054-f2192112ca5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:13:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (095e45d7-9750-4704-b054-f2192112ca5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c971125-648b-420c-8781-ccc2ed693142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86c6183efa2c451680da4cec09ccc446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:13:40Z,use_quota=True,user_id='428fbf1ce2d8422d8d27131d05d9d218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(856c1824-7fcb-4c6c-a1ff-20aad263dc6f),volume_type_id=856c1824-7fcb-4c6c-a1ff-20aad263dc6f)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbfeb85f-a6f5-406c-b88d-3bd86b890d5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:13:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dbfeb85f-a6f5-406c-b88d-3bd86b890d5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29bec46c-a4a9-411d-a7bb-d04a1fe62af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:13:40 devstack cinder-volume[87192]: DEBUG cinder.image.glance [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Creating Keystone auth plugin from conf {{(pid=87192) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 10:13:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29bec46c-a4a9-411d-a7bb-d04a1fe62af6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1c971125-648b-420c-8781-ccc2ed693142', 'volume_name': 'volume-1c971125-648b-420c-8781-ccc2ed693142', 'volume_size': 1, 'image_id': 'aedaf697-1577-48b0-b775-abb185955f15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aedaf697-1577-48b0-b775-abb185955f15', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a4d3cdbfd64c5b6f2feb098f5edeffc5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '86c6183efa2c451680da4cec09ccc446', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '63913fd10165f030e03d1be224f4f62b59de53a20c7b03129f2f4e636f094f1c4d038112906ef7cf0f67240b76d0a8f69fa74296474c4a9841b815a90a596ea7', 'id': 'aedaf697-1577-48b0-b775-abb185955f15', 'created_at': datetime.datetime(2026, 7, 9, 8, 13, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 8, 13, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aedaf697-1577-48b0-b775-abb185955f15/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c73de50-8041-49bd-8651-d683b08cdd92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:13:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c73de50-8041-49bd-8651-d683b08cdd92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f3fb68-6b53-495b-b085-0f5a7c1ed7b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:13:40 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Volume 1c971125-648b-420c-8781-ccc2ed693142: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1c971125-648b-420c-8781-ccc2ed693142', 'volume_size': 1, 'image_id': 'aedaf697-1577-48b0-b775-abb185955f15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aedaf697-1577-48b0-b775-abb185955f15', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a4d3cdbfd64c5b6f2feb098f5edeffc5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '86c6183efa2c451680da4cec09ccc446', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '63913fd10165f030e03d1be224f4f62b59de53a20c7b03129f2f4e636f094f1c4d038112906ef7cf0f67240b76d0a8f69fa74296474c4a9841b815a90a596ea7', 'id': 'aedaf697-1577-48b0-b775-abb185955f15', 'created_at': datetime.datetime(2026, 7, 9, 8, 13, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 8, 13, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aedaf697-1577-48b0-b775-abb185955f15/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 10:13:40 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Trying to clone 1c971125-648b-420c-8781-ccc2ed693142 from image aedaf697-1577-48b0-b775-abb185955f15 at location (None, [{'url': 'file:///opt/stack/data/glance/images/aedaf697-1577-48b0-b775-abb185955f15', 'metadata': {}}]). {{(pid=87192) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 10:13:41 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 10:13:41 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Image download 0.00 MB at 0.00 MB/s Jul 09 10:13:41 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9b93b8a-4ca8-4011-a880-ebe6e0e20e1c]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:41 devstack sudo[101938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD Jul 09 10:13:41 devstack sudo[101938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:41 devstack sudo[101938]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD" returned: 0 in 0.766s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:41 devstack sudo[101942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD Jul 09 10:13:42 devstack sudo[101942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:42 devstack sudo[101942]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD" returned: 1 in 0.814s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:13:42 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Temporary image aedaf697-1577-48b0-b775-abb185955f15 is fetched for user 428fbf1ce2d8422d8d27131d05d9d218. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 10:13:42 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[32de3f78-4913-4d63-98a7-6ed120344964]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:42 devstack sudo[101953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD Jul 09 10:13:42 devstack sudo[101953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:43 devstack sudo[101953]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD" returned: 0 in 0.801s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:43 devstack sudo[101958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD Jul 09 10:13:43 devstack sudo[101958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:44 devstack sudo[101958]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD" returned: 1 in 0.776s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:13:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:13:40Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c971125-648b-420c-8781-ccc2ed693142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86c6183efa2c451680da4cec09ccc446',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:13:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:13:40Z,use_quota=True,user_id='428fbf1ce2d8422d8d27131d05d9d218',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(856c1824-7fcb-4c6c-a1ff-20aad263dc6f),volume_type_id=856c1824-7fcb-4c6c-a1ff-20aad263dc6f)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:13:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Creating volume 1c971125-648b-420c-8781-ccc2ed693142 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:13:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:13:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:13:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:13:44 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:13:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:44 devstack sudo[101963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 1073741824 Jul 09 10:13:44 devstack sudo[101963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:45 devstack sudo[101963]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 1073741824" returned: 0 in 0.996s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:45 devstack sudo[101968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 Jul 09 10:13:45 devstack sudo[101968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:46 devstack sudo[101968]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142" returned: 0 in 0.708s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] <== create_volume: return (1759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:13:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.762s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:46 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Attempting download of aedaf697-1577-48b0-b775-abb185955f15 ((None, [{'url': 'file:///opt/stack/data/glance/images/aedaf697-1577-48b0-b775-abb185955f15', 'metadata': {}}])) to volume 1c971125-648b-420c-8781-ccc2ed693142. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 10:13:46 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[513e5efb-fc72-4681-8fbd-5bef52053500]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aedaf697-1577-48b0-b775-abb185955f15_sc1csmwi {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:46 devstack sudo[101971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aedaf697-1577-48b0-b775-abb185955f15_sc1csmwi Jul 09 10:13:46 devstack sudo[101971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:46 devstack sudo[101971]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_aedaf697-1577-48b0-b775-abb185955f15_sc1csmwi" returned: 0 in 0.743s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aedaf697-1577-48b0-b775-abb185955f15_sc1csmwi {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:47 devstack sudo[101975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aedaf697-1577-48b0-b775-abb185955f15_sc1csmwi Jul 09 10:13:47 devstack sudo[101975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:47 devstack sudo[101975]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aedaf697-1577-48b0-b775-abb185955f15_sc1csmwi" returned: 1 in 0.757s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_aedaf697-1577-48b0-b775-abb185955f15_sc1csmwi' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:13:47 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf75e3f6-9a16-48cf-8081-db7399851867]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:47 devstack sudo[101993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD Jul 09 10:13:47 devstack sudo[101993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:48 devstack sudo[101993]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD" returned: 0 in 0.736s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:48 devstack sudo[102000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD Jul 09 10:13:48 devstack sudo[102000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:49 devstack sudo[102000]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD" returned: 1 in 0.777s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:13:49 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] aedaf697-1577-48b0-b775-abb185955f15 was raw, converting to raw {{(pid=87192) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 10:13:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:49 devstack sudo[102006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 Jul 09 10:13:49 devstack sudo[102006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:49 devstack sudo[102006]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142" returned: 0 in 0.718s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:49 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_aedaf697-1577-48b0-b775-abb185955f15_w22cddyedevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:13:49 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 10:13:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:49 devstack sudo[102011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 1G Jul 09 10:13:49 devstack sudo[102011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:50 devstack sudo[102011]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 1G" returned: 0 in 0.830s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:50 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ede24bc-2dd8-40d5-810d-440fe1f02f1d]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:50 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 Jul 09 10:13:50 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:51 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142" returned: 0 in 0.797s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:51 devstack sudo[102065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 Jul 09 10:13:51 devstack sudo[102065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:52 devstack sudo[102065]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142" returned: 1 in 0.811s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:13:52 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Downloaded image aedaf697-1577-48b0-b775-abb185955f15 ((None, [{'url': 'file:///opt/stack/data/glance/images/aedaf697-1577-48b0-b775-abb185955f15', 'metadata': {}}])) to volume 1c971125-648b-420c-8781-ccc2ed693142 successfully. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 10:13:52 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Temporary image aedaf697-1577-48b0-b775-abb185955f15 for user 428fbf1ce2d8422d8d27131d05d9d218 is deleted. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 10:13:52 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Marking volume 1c971125-648b-420c-8781-ccc2ed693142 as bootable. {{(pid=87192) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 10:13:52 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Copying metadata from image aedaf697-1577-48b0-b775-abb185955f15 to 1c971125-648b-420c-8781-ccc2ed693142. {{(pid=87192) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 10:13:52 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Creating volume glance metadata for volume 1c971125-648b-420c-8781-ccc2ed693142 backed by image aedaf697-1577-48b0-b775-abb185955f15 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'aedaf697-1577-48b0-b775-abb185955f15', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'a4d3cdbfd64c5b6f2feb098f5edeffc5', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87192) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 10:13:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70f3fb68-6b53-495b-b085-0f5a7c1ed7b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c971125-648b-420c-8781-ccc2ed693142', 'volume_size': 1, 'image_id': 'aedaf697-1577-48b0-b775-abb185955f15', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/aedaf697-1577-48b0-b775-abb185955f15', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'a4d3cdbfd64c5b6f2feb098f5edeffc5', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '86c6183efa2c451680da4cec09ccc446', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '63913fd10165f030e03d1be224f4f62b59de53a20c7b03129f2f4e636f094f1c4d038112906ef7cf0f67240b76d0a8f69fa74296474c4a9841b815a90a596ea7', 'id': 'aedaf697-1577-48b0-b775-abb185955f15', 'created_at': datetime.datetime(2026, 7, 9, 8, 13, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 8, 13, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/aedaf697-1577-48b0-b775-abb185955f15/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987b0d2d-10b7-4d3d-a42a-3227245ec9af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:13:52 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Volume volume-1c971125-648b-420c-8781-ccc2ed693142 (1c971125-648b-420c-8781-ccc2ed693142): created successfully Jul 09 10:13:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (987b0d2d-10b7-4d3d-a42a-3227245ec9af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:13:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Flow 'volume_create_manager' (c7a0769d-fdfa-4dcf-9cbe-b8419e9387c3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:13:52 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-82c84d80-5f5b-46fe-bb3f-64865c61e8a2 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Created volume successfully. Jul 09 10:13:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Acquiring lock "cinder-1c971125-648b-420c-8781-ccc2ed693142-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Lock "cinder-1c971125-648b-420c-8781-ccc2ed693142-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:53 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=129,cinder:DELETE=9,cinder:SELECT=86,cinder:INSERT=35 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:13:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Acquiring lock "cinder-quobyte-1c971125-648b-420c-8781-ccc2ed693142" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Lock "cinder-quobyte-1c971125-648b-420c-8781-ccc2ed693142" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:53 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9543cc1-38a7-4fc9-914b-5d97fae08ddb]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:13:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:53 devstack sudo[102092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 Jul 09 10:13:53 devstack sudo[102092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:54 devstack sudo[102092]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142" returned: 0 in 0.860s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:54 devstack sudo[102096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 Jul 09 10:13:54 devstack sudo[102096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:55 devstack sudo[102096]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142" returned: 1 in 0.832s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:13:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:55 devstack sudo[102101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142 Jul 09 10:13:55 devstack sudo[102101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eab11171-d1d4-4d5c-bd43-911afcac204b tempest-VolumesActionsTest-1158003976 None] Acquiring lock "cinder-149c9a9d-da68-4042-8cd2-d6ce95819c49" by "attach_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eab11171-d1d4-4d5c-bd43-911afcac204b tempest-VolumesActionsTest-1158003976 None] Lock "cinder-149c9a9d-da68-4042-8cd2-d6ce95819c49" acquired by "attach_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-eab11171-d1d4-4d5c-bd43-911afcac204b tempest-VolumesActionsTest-1158003976 None] Attaching volume 149c9a9d-da68-4042-8cd2-d6ce95819c49 to instance b90fb044-baa2-4d78-901b-743ed27250a2 at mountpoint /dev/vdb on host None. Jul 09 10:13:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-eab11171-d1d4-4d5c-bd43-911afcac204b tempest-VolumesActionsTest-1158003976 None] Attach volume completed successfully. Jul 09 10:13:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-eab11171-d1d4-4d5c-bd43-911afcac204b tempest-VolumesActionsTest-1158003976 None] Lock "cinder-149c9a9d-da68-4042-8cd2-d6ce95819c49" released by "attach_volume" :: held 0.117s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:55 devstack sudo[102101]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1c971125-648b-420c-8781-ccc2ed693142" returned: 0 in 0.705s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Lock "cinder-quobyte-1c971125-648b-420c-8781-ccc2ed693142" released by "delete_volume" :: held 2.457s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:55 devstack cinder-volume[87192]: WARNING cinder.quota [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:13:55 devstack cinder-volume[87192]: WARNING cinder.quota [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 09 10:13:55 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Created reservations ['cb7b35ea-efde-4c4f-928f-b4c2f6f4ec6f', 'e0f32099-59a0-446f-95ea-bbffd3c556e2', 'ecffe8f7-e041-401a-b64b-df6e0c297fcf', '2b80b566-81b9-4daf-b368-ac812515fcae'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:13:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:13:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:13:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:13:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:13:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:13:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:13:56 devstack sudo[102105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:13:56 devstack sudo[102105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:13:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a93aa6d1-cc5e-42e0-ab6a-e1635d3842f1 tempest-VolumesActionsTest-1158003976 None] Acquiring lock "cinder-149c9a9d-da68-4042-8cd2-d6ce95819c49-detach_volume" by "detach_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:13:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a93aa6d1-cc5e-42e0-ab6a-e1635d3842f1 tempest-VolumesActionsTest-1158003976 None] Lock "cinder-149c9a9d-da68-4042-8cd2-d6ce95819c49-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:13:56 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a93aa6d1-cc5e-42e0-ab6a-e1635d3842f1 tempest-VolumesActionsTest-1158003976 None] Detaching volume 149c9a9d-da68-4042-8cd2-d6ce95819c49 from instance b90fb044-baa2-4d78-901b-743ed27250a2. Jul 09 10:13:56 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a93aa6d1-cc5e-42e0-ab6a-e1635d3842f1 tempest-VolumesActionsTest-1158003976 None] Detach volume completed successfully. Jul 09 10:13:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a93aa6d1-cc5e-42e0-ab6a-e1635d3842f1 tempest-VolumesActionsTest-1158003976 None] Lock "cinder-149c9a9d-da68-4042-8cd2-d6ce95819c49-detach_volume" released by "detach_volume" :: held 0.064s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:13:56 devstack sudo[102105]: pam_unix(sudo:session): session closed for user root Jul 09 10:13:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.723s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:13:56 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:13:56 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Deleted volume successfully. Jul 09 10:13:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a53e1b7f-4035-4b22-9599-00a75e9ef938 tempest-VolumeAndVolumeTypeFromImageTest-650086721 None] Lock "cinder-1c971125-648b-420c-8781-ccc2ed693142-delete_volume" released by "delete_volume" :: held 3.440s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=108,cinder:UPDATE=122,cinder:INSERT=35,cinder:DELETE=12 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Flow 'volume_create_manager' (e6d74965-5d7d-422b-ab1d-2a077697a61d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f44aae-9287-4e77-b934-87661e824326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61f44aae-9287-4e77-b934-87661e824326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1704301015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54885dad-06c6-41a3-8d2f-96da31cba503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390626d0892941afb51c1c9edce1490c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:14:02Z,use_quota=True,user_id='66aa8db753bb444f9c5e6b3489f8593c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab602b4-ef8e-44be-865b-1e0d134ac9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fab602b4-ef8e-44be-865b-1e0d134ac9ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7eb5904-5d4a-4268-ad30-1b994de688be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d7eb5904-5d4a-4268-ad30-1b994de688be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54885dad-06c6-41a3-8d2f-96da31cba503', 'volume_name': 'volume-54885dad-06c6-41a3-8d2f-96da31cba503', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f37992-6dcf-45f1-9221-c252bc964a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24f37992-6dcf-45f1-9221-c252bc964a31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b7d7a7-c2c9-4db7-a5db-857c2537b7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:14:01 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Volume 54885dad-06c6-41a3-8d2f-96da31cba503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54885dad-06c6-41a3-8d2f-96da31cba503', 'volume_size': 1} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:14:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1704301015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54885dad-06c6-41a3-8d2f-96da31cba503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390626d0892941afb51c1c9edce1490c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:14:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:14:02Z,use_quota=True,user_id='66aa8db753bb444f9c5e6b3489f8593c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Creating volume 54885dad-06c6-41a3-8d2f-96da31cba503 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:14:01 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:14:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:01 devstack sudo[102133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 1073741824 Jul 09 10:14:01 devstack sudo[102133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:02 devstack sudo[102133]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 1073741824" returned: 0 in 0.804s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:02 devstack sudo[102140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 Jul 09 10:14:02 devstack sudo[102140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:03 devstack sudo[102140]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503" returned: 0 in 0.631s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] <== create_volume: return (1571ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:14:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:14:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (63b7d7a7-c2c9-4db7-a5db-857c2537b7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54885dad-06c6-41a3-8d2f-96da31cba503', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:14:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad30201-5283-4852-b88a-7e5c3a49ec2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:14:03 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Volume volume-54885dad-06c6-41a3-8d2f-96da31cba503 (54885dad-06c6-41a3-8d2f-96da31cba503): created successfully Jul 09 10:14:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ad30201-5283-4852-b88a-7e5c3a49ec2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:14:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Flow 'volume_create_manager' (e6d74965-5d7d-422b-ab1d-2a077697a61d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:14:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d86184cb-8f25-4c6e-84bc-843863f983ef tempest-VolumeDependencyTests-131698928 None] Created volume successfully. Jul 09 10:14:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0e88ec49-cc84-485c-af9f-7fd7fcf534f5 tempest-VolumeDependencyTests-131698928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:14:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0e88ec49-cc84-485c-af9f-7fd7fcf534f5 tempest-VolumeDependencyTests-131698928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:14:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0e88ec49-cc84-485c-af9f-7fd7fcf534f5 tempest-VolumeDependencyTests-131698928 None] Creating offline snapshot 6b040375-5174-4a3d-80a5-af02e64b8a5a of volume 54885dad-06c6-41a3-8d2f-96da31cba503 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:14:03 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8d8323b-abba-4ca6-af49-94a8e8b0c6f6]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:14:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e88ec49-cc84-485c-af9f-7fd7fcf534f5 tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:04 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 Jul 09 10:14:04 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ccd8fa71-7e50-4469-a5e8-2fcd52986a51 tempest-VolumesActionsTest-1158003976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:14:04 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e88ec49-cc84-485c-af9f-7fd7fcf534f5 tempest-VolumeDependencyTests-131698928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503" returned: 0 in 0.780s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e88ec49-cc84-485c-af9f-7fd7fcf534f5 tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:04 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a 1G Jul 09 10:14:04 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:05 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e88ec49-cc84-485c-af9f-7fd7fcf534f5 tempest-VolumeDependencyTests-131698928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a 1G" returned: 0 in 0.835s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e88ec49-cc84-485c-af9f-7fd7fcf534f5 tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54885dad-06c6-41a3-8d2f-96da31cba503 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:05 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54885dad-06c6-41a3-8d2f-96da31cba503 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a Jul 09 10:14:05 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:06 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e88ec49-cc84-485c-af9f-7fd7fcf534f5 tempest-VolumeDependencyTests-131698928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54885dad-06c6-41a3-8d2f-96da31cba503 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a" returned: 0 in 0.692s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:06 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-0e88ec49-cc84-485c-af9f-7fd7fcf534f5 tempest-VolumeDependencyTests-131698928 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a is being set with open permissions: ugo+rw Jul 09 10:14:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e88ec49-cc84-485c-af9f-7fd7fcf534f5 tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:06 devstack sudo[102160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a Jul 09 10:14:06 devstack sudo[102160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:06 devstack sudo[102160]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e88ec49-cc84-485c-af9f-7fd7fcf534f5 tempest-VolumeDependencyTests-131698928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a" returned: 0 in 0.626s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e88ec49-cc84-485c-af9f-7fd7fcf534f5 tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:06 devstack sudo[102163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.info Jul 09 10:14:06 devstack sudo[102163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:07 devstack sudo[102163]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e88ec49-cc84-485c-af9f-7fd7fcf534f5 tempest-VolumeDependencyTests-131698928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.info" returned: 0 in 0.628s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:07 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-0e88ec49-cc84-485c-af9f-7fd7fcf534f5 tempest-VolumeDependencyTests-131698928 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.info is being set with open permissions: ugo+rw Jul 09 10:14:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e88ec49-cc84-485c-af9f-7fd7fcf534f5 tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:07 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.info Jul 09 10:14:07 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:08 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0e88ec49-cc84-485c-af9f-7fd7fcf534f5 tempest-VolumeDependencyTests-131698928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.info" returned: 0 in 0.641s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0e88ec49-cc84-485c-af9f-7fd7fcf534f5 tempest-VolumeDependencyTests-131698928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.285s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:14:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ccd8fa71-7e50-4469-a5e8-2fcd52986a51 tempest-VolumesActionsTest-1158003976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 3.536s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:14:08 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b532445b-0219-427a-8e45-877edda605f9]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:14:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ccd8fa71-7e50-4469-a5e8-2fcd52986a51 tempest-VolumesActionsTest-1158003976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0e88ec49-cc84-485c-af9f-7fd7fcf534f5 tempest-VolumeDependencyTests-131698928 None] Create snapshot completed successfully Jul 09 10:14:08 devstack sudo[102170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 Jul 09 10:14:08 devstack sudo[102170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:08 devstack sudo[102170]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ccd8fa71-7e50-4469-a5e8-2fcd52986a51 tempest-VolumesActionsTest-1158003976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49" returned: 0 in 0.747s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:09 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fdbf118-df0b-4a2e-a1c6-7d98b37056e1]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:14:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ccd8fa71-7e50-4469-a5e8-2fcd52986a51 tempest-VolumesActionsTest-1158003976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:09 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 Jul 09 10:14:09 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:09 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:14:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Flow 'volume_create_manager' (97b4c948-65b0-4ea3-89d3-b74e6c59623a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:14:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8a9ca4-17e8-4a1e-99d0-76f5d3e6cd8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:14:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c8a9ca4-17e8-4a1e-99d0-76f5d3e6cd8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:14:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-884901371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40321293-4637-446b-abaa-4824751d6bc7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='390626d0892941afb51c1c9edce1490c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:14:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=6b040375-5174-4a3d-80a5-af02e64b8a5a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:14:10Z,use_quota=True,user_id='66aa8db753bb444f9c5e6b3489f8593c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:14:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06345f40-b0d7-412a-8c3c-487df73b01d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:14:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06345f40-b0d7-412a-8c3c-487df73b01d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:14:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c22a35e-1357-4dc9-9c47-7316e611468f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:14:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c22a35e-1357-4dc9-9c47-7316e611468f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '40321293-4637-446b-abaa-4824751d6bc7', 'volume_name': 'volume-40321293-4637-446b-abaa-4824751d6bc7', 'volume_size': 1, 'snapshot_id': '6b040375-5174-4a3d-80a5-af02e64b8a5a'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:14:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7fe7134-7c83-4708-bf1f-7eae1d16b79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:14:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7fe7134-7c83-4708-bf1f-7eae1d16b79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:14:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ead1658-a985-4c3b-9da9-8a402c563279) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:14:09 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Volume 40321293-4637-446b-abaa-4824751d6bc7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-40321293-4637-446b-abaa-4824751d6bc7', 'volume_size': 1, 'snapshot_id': '6b040375-5174-4a3d-80a5-af02e64b8a5a'} Jul 09 10:14:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:14:09 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ccd8fa71-7e50-4469-a5e8-2fcd52986a51 tempest-VolumesActionsTest-1158003976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49" returned: 0 in 0.803s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ccd8fa71-7e50-4469-a5e8-2fcd52986a51 tempest-VolumesActionsTest-1158003976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 /opt/stack/data/cinder/conversion/149c9a9d-da68-4042-8cd2-d6ce95819c49.temp_image.131d6cc3-1d51-4457-a916-03c050061715i6d2lq7i.img {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:09 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 /opt/stack/data/cinder/conversion/149c9a9d-da68-4042-8cd2-d6ce95819c49.temp_image.131d6cc3-1d51-4457-a916-03c050061715i6d2lq7i.img Jul 09 10:14:09 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:14 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ccd8fa71-7e50-4469-a5e8-2fcd52986a51 tempest-VolumesActionsTest-1158003976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 /opt/stack/data/cinder/conversion/149c9a9d-da68-4042-8cd2-d6ce95819c49.temp_image.131d6cc3-1d51-4457-a916-03c050061715i6d2lq7i.img" returned: 0 in 4.234s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:14 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9eb0b3-e3e5-4bdf-8191-1f16745b6649]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:14:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ccd8fa71-7e50-4469-a5e8-2fcd52986a51 tempest-VolumesActionsTest-1158003976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:14 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 Jul 09 10:14:14 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:14 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ccd8fa71-7e50-4469-a5e8-2fcd52986a51 tempest-VolumesActionsTest-1158003976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49" returned: 0 in 0.901s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:14 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-ccd8fa71-7e50-4469-a5e8-2fcd52986a51 tempest-VolumesActionsTest-1158003976 None] Image conversion details: src /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49, size 1024.00 MB, duration 4.24 sec, destination /opt/stack/data/cinder/conversion/149c9a9d-da68-4042-8cd2-d6ce95819c49.temp_image.131d6cc3-1d51-4457-a916-03c050061715i6d2lq7i.img {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:14:14 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-ccd8fa71-7e50-4469-a5e8-2fcd52986a51 tempest-VolumesActionsTest-1158003976 None] Converted 1024.00 MB image at 241.78 MB/s Jul 09 10:14:14 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-ccd8fa71-7e50-4469-a5e8-2fcd52986a51 tempest-VolumesActionsTest-1158003976 None] 131d6cc3-1d51-4457-a916-03c050061715 was raw, no need to convert to raw {{(pid=87192) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 09 10:14:24 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=6,cinder:DELETE=2,cinder:SELECT=5,cinder:INSERT=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:14:24 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:INSERT=5,cinder:SELECT=22,cinder:UPDATE=14 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:14:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:14:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:14:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:14:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:14:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:14:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:14:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:29 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:14:29 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:30 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.653s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:14:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:14:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:14:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ccd8fa71-7e50-4469-a5e8-2fcd52986a51 tempest-VolumesActionsTest-1158003976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 25.432s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ccd8fa71-7e50-4469-a5e8-2fcd52986a51 tempest-VolumesActionsTest-1158003976 None] Uploaded volume to glance image-id: 131d6cc3-1d51-4457-a916-03c050061715. {{(pid=87192) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 23.890s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Acquiring lock "cinder-quobyte-6b040375-5174-4a3d-80a5-af02e64b8a5a-40321293-4637-446b-abaa-4824751d6bc7" by "_create_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Lock "cinder-quobyte-6b040375-5174-4a3d-80a5-af02e64b8a5a-40321293-4637-446b-abaa-4824751d6bc7" acquired by "_create_volume_from_snapshot" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Creating volume 40321293-4637-446b-abaa-4824751d6bc7 from snapshot 6b040375-5174-4a3d-80a5-af02e64b8a5a {{(pid=87192) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Acquiring lock "cinder-quobyte-40321293-4637-446b-abaa-4824751d6bc7" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:14:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ccd8fa71-7e50-4469-a5e8-2fcd52986a51 tempest-VolumesActionsTest-1158003976 None] Copy volume to image completed successfully. Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Lock "cinder-quobyte-40321293-4637-446b-abaa-4824751d6bc7" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] snapshot: 6b040375-5174-4a3d-80a5-af02e64b8a5a, volume: 40321293-4637-446b-abaa-4824751d6bc7, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[500ef4b9-0ecc-423c-8c5e-4c77574337b3]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:14:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:33 devstack sudo[102240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a Jul 09 10:14:33 devstack sudo[102240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:34 devstack sudo[102240]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a" returned: 0 in 0.725s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54885dad-06c6-41a3-8d2f-96da31cba503(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:14:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 10:14:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 10:14:34 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f518beb2-465d-4ec2-bcb6-0c37244c9cf2]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:14:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:34 devstack sudo[102245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 Jul 09 10:14:34 devstack sudo[102245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:35 devstack sudo[102245]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503" returned: 0 in 0.755s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:35 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Path /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40321293-4637-446b-abaa-4824751d6bc7 not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 10:14:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40321293-4637-446b-abaa-4824751d6bc7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:35 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40321293-4637-446b-abaa-4824751d6bc7 Jul 09 10:14:35 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:14:39 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40321293-4637-446b-abaa-4824751d6bc7" returned: 0 in 4.395s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:39 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2690be-7b17-4fbf-8fd5-bf6b12a955eb]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:14:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:39 devstack sudo[102266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 Jul 09 10:14:39 devstack sudo[102266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:40 devstack sudo[102266]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503" returned: 0 in 0.892s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:40 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Image conversion details: src /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503, size 1024.00 MB, duration 4.40 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40321293-4637-446b-abaa-4824751d6bc7 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:14:40 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Converted 1024.00 MB image at 232.94 MB/s Jul 09 10:14:40 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40321293-4637-446b-abaa-4824751d6bc7 is being set with open permissions: ugo+rw Jul 09 10:14:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40321293-4637-446b-abaa-4824751d6bc7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:40 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40321293-4637-446b-abaa-4824751d6bc7 Jul 09 10:14:40 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:41 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40321293-4637-446b-abaa-4824751d6bc7" returned: 0 in 0.628s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Lock "cinder-quobyte-40321293-4637-446b-abaa-4824751d6bc7" released by "_copy_volume_from_snapshot" :: held 7.492s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:14:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Lock "cinder-quobyte-6b040375-5174-4a3d-80a5-af02e64b8a5a-40321293-4637-446b-abaa-4824751d6bc7" released by "_create_volume_from_snapshot" :: held 7.521s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:14:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.545s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:14:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 5.656s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:14:41 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[28adaab6-550b-47b7-a161-781a71660260]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:14:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ead1658-a985-4c3b-9da9-8a402c563279) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40321293-4637-446b-abaa-4824751d6bc7', 'volume_size': 1, 'snapshot_id': '6b040375-5174-4a3d-80a5-af02e64b8a5a'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:14:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd323c8-7f4e-42c5-8479-8d636d34e8b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:14:41 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Volume volume-40321293-4637-446b-abaa-4824751d6bc7 (40321293-4637-446b-abaa-4824751d6bc7): created successfully Jul 09 10:14:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dd323c8-7f4e-42c5-8479-8d636d34e8b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:14:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Flow 'volume_create_manager' (97b4c948-65b0-4ea3-89d3-b74e6c59623a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:14:41 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8b1f9ba6-13d6-471a-9209-ee10b54f6dc8 tempest-VolumeDependencyTests-131698928 None] Created volume successfully. Jul 09 10:14:41 devstack sudo[102274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 Jul 09 10:14:41 devstack sudo[102274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:41 devstack sudo[102274]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] Acquiring lock "cinder-6b040375-5174-4a3d-80a5-af02e64b8a5a-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:14:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49" returned: 0 in 0.759s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] Lock "cinder-6b040375-5174-4a3d-80a5-af02e64b8a5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:14:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] Acquiring lock "cinder-quobyte-54885dad-06c6-41a3-8d2f-96da31cba503" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:14:42 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2e8e970-71fc-47d6-8a93-b5965680dfeb]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:14:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] Lock "cinder-quobyte-54885dad-06c6-41a3-8d2f-96da31cba503" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:14:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] Acquiring lock "cinder-quobyte-6b040375-5174-4a3d-80a5-af02e64b8a5a" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:14:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] Lock "cinder-quobyte-6b040375-5174-4a3d-80a5-af02e64b8a5a" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:14:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] Deleting offline snapshot 6b040375-5174-4a3d-80a5-af02e64b8a5a of volume 54885dad-06c6-41a3-8d2f-96da31cba503 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:14:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] snapshot_file for this snap is: volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:14:42 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[40eadad6-729b-4030-8c4b-e4f87c089d12]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:14:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:42 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 Jul 09 10:14:42 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:42 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a Jul 09 10:14:42 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:42 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49" returned: 0 in 0.737s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 /opt/stack/data/cinder/conversion/149c9a9d-da68-4042-8cd2-d6ce95819c49.temp_image.599b2839-8eb1-4c6b-bd7e-643a6f95a5627us7phxt.img {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:42 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 /opt/stack/data/cinder/conversion/149c9a9d-da68-4042-8cd2-d6ce95819c49.temp_image.599b2839-8eb1-4c6b-bd7e-643a6f95a5627us7phxt.img Jul 09 10:14:42 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:42 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a" returned: 0 in 0.745s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54885dad-06c6-41a3-8d2f-96da31cba503(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:14:42 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f353f9c-dcd3-4d25-9d2a-dc90f294c8c3]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:14:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:42 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 Jul 09 10:14:42 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:43 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503" returned: 0 in 0.990s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:43 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a Jul 09 10:14:43 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:45 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a" returned: 0 in 1.287s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:45 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a Jul 09 10:14:45 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:46 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503.6b040375-5174-4a3d-80a5-af02e64b8a5a" returned: 0 in 1.435s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] Lock "cinder-quobyte-6b040375-5174-4a3d-80a5-af02e64b8a5a" released by "_delete_snapshot" :: held 4.602s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:14:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] Lock "cinder-quobyte-54885dad-06c6-41a3-8d2f-96da31cba503" released by "delete_snapshot" :: held 4.640s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:14:47 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] Created reservations ['3fb3a11b-c131-4e94-91c8-8c179ff1685e', 'd97d2968-553c-438a-a949-c0cfecbefcc0', '54c88870-66be-430c-b66d-9501bdf17487', 'ddc62f49-b688-4cd9-9b3d-1fcf8915f0b7'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:14:47 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 /opt/stack/data/cinder/conversion/149c9a9d-da68-4042-8cd2-d6ce95819c49.temp_image.599b2839-8eb1-4c6b-bd7e-643a6f95a5627us7phxt.img" returned: 0 in 4.429s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:47 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9ddf4a-1639-456d-b9a3-1e706bdce25e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:14:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:47 devstack sudo[102323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 Jul 09 10:14:47 devstack sudo[102323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] Delete snapshot completed successfully. Jul 09 10:14:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-100f4d34-d6f0-46e0-a839-e48c6b9a38cf tempest-VolumeDependencyTests-131698928 None] Lock "cinder-6b040375-5174-4a3d-80a5-af02e64b8a5a-delete_snapshot" released by "delete_snapshot" :: held 5.309s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:14:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b47b0bec-4ccf-412e-af0a-85134b3ec1b7 tempest-VolumeDependencyTests-131698928 None] Acquiring lock "cinder-54885dad-06c6-41a3-8d2f-96da31cba503-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:14:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b47b0bec-4ccf-412e-af0a-85134b3ec1b7 tempest-VolumeDependencyTests-131698928 None] Lock "cinder-54885dad-06c6-41a3-8d2f-96da31cba503-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:14:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b47b0bec-4ccf-412e-af0a-85134b3ec1b7 tempest-VolumeDependencyTests-131698928 None] Acquiring lock "cinder-quobyte-54885dad-06c6-41a3-8d2f-96da31cba503" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:14:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b47b0bec-4ccf-412e-af0a-85134b3ec1b7 tempest-VolumeDependencyTests-131698928 None] Lock "cinder-quobyte-54885dad-06c6-41a3-8d2f-96da31cba503" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:14:47 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7177942-0303-48d0-806f-530b11a9388c]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:14:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b47b0bec-4ccf-412e-af0a-85134b3ec1b7 tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:47 devstack sudo[102325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 Jul 09 10:14:47 devstack sudo[102325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:48 devstack sudo[102323]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49" returned: 0 in 1.007s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:48 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] Image conversion details: src /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49, size 1024.00 MB, duration 4.43 sec, destination /opt/stack/data/cinder/conversion/149c9a9d-da68-4042-8cd2-d6ce95819c49.temp_image.599b2839-8eb1-4c6b-bd7e-643a6f95a5627us7phxt.img {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:14:48 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] Converted 1024.00 MB image at 231.14 MB/s Jul 09 10:14:48 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] 599b2839-8eb1-4c6b-bd7e-643a6f95a562 was raw, converting to qcow2 {{(pid=87192) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 09 10:14:48 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[68e1167b-c512-4e26-bb0b-5bfcdca30b13]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:14:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/149c9a9d-da68-4042-8cd2-d6ce95819c49.temp_image.599b2839-8eb1-4c6b-bd7e-643a6f95a5627us7phxt.img {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:48 devstack sudo[102331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/149c9a9d-da68-4042-8cd2-d6ce95819c49.temp_image.599b2839-8eb1-4c6b-bd7e-643a6f95a5627us7phxt.img Jul 09 10:14:48 devstack sudo[102331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:48 devstack sudo[102325]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b47b0bec-4ccf-412e-af0a-85134b3ec1b7 tempest-VolumeDependencyTests-131698928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503" returned: 0 in 0.837s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b47b0bec-4ccf-412e-af0a-85134b3ec1b7 tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:48 devstack sudo[102336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503 Jul 09 10:14:48 devstack sudo[102336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:48 devstack sudo[102331]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/149c9a9d-da68-4042-8cd2-d6ce95819c49.temp_image.599b2839-8eb1-4c6b-bd7e-643a6f95a5627us7phxt.img" returned: 0 in 0.763s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/149c9a9d-da68-4042-8cd2-d6ce95819c49.temp_image.599b2839-8eb1-4c6b-bd7e-643a6f95a5627us7phxt.img {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:49 devstack sudo[102341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/149c9a9d-da68-4042-8cd2-d6ce95819c49.temp_image.599b2839-8eb1-4c6b-bd7e-643a6f95a5627us7phxt.img Jul 09 10:14:49 devstack sudo[102341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:49 devstack sudo[102336]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b47b0bec-4ccf-412e-af0a-85134b3ec1b7 tempest-VolumeDependencyTests-131698928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-54885dad-06c6-41a3-8d2f-96da31cba503" returned: 0 in 0.645s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b47b0bec-4ccf-412e-af0a-85134b3ec1b7 tempest-VolumeDependencyTests-131698928 None] Lock "cinder-quobyte-54885dad-06c6-41a3-8d2f-96da31cba503" released by "delete_volume" :: held 1.540s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:14:49 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-b47b0bec-4ccf-412e-af0a-85134b3ec1b7 tempest-VolumeDependencyTests-131698928 None] Created reservations ['3b05a0c2-03f9-4f8e-83e0-4128f72522df', '60622c1f-826a-47ae-80cf-b03a449cccc0', '9318e951-3a85-4fc8-9de2-c5e0f02515b7', 'db6e9b0d-3f4d-4146-8d73-8668145e108b'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:14:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b47b0bec-4ccf-412e-af0a-85134b3ec1b7 tempest-VolumeDependencyTests-131698928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:14:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b47b0bec-4ccf-412e-af0a-85134b3ec1b7 tempest-VolumeDependencyTests-131698928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:14:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b47b0bec-4ccf-412e-af0a-85134b3ec1b7 tempest-VolumeDependencyTests-131698928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:14:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b47b0bec-4ccf-412e-af0a-85134b3ec1b7 tempest-VolumeDependencyTests-131698928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:14:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b47b0bec-4ccf-412e-af0a-85134b3ec1b7 tempest-VolumeDependencyTests-131698928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:14:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b47b0bec-4ccf-412e-af0a-85134b3ec1b7 tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:49 devstack sudo[102344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:14:49 devstack sudo[102344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ae25a619-543d-4bca-adf5-ed24fbc7963c tempest-VolumeDependencyTests-131698928 None] Acquiring lock "cinder-40321293-4637-446b-abaa-4824751d6bc7-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:14:49 devstack sudo[102341]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/149c9a9d-da68-4042-8cd2-d6ce95819c49.temp_image.599b2839-8eb1-4c6b-bd7e-643a6f95a5627us7phxt.img" returned: 1 in 0.744s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/149c9a9d-da68-4042-8cd2-d6ce95819c49.temp_image.599b2839-8eb1-4c6b-bd7e-643a6f95a5627us7phxt.img' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:14:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/149c9a9d-da68-4042-8cd2-d6ce95819c49.temp_image.599b2839-8eb1-4c6b-bd7e-643a6f95a5627us7phxt.img /opt/stack/data/cinder/conversion/vol_upload_o3vjvpq3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ae25a619-543d-4bca-adf5-ed24fbc7963c tempest-VolumeDependencyTests-131698928 None] Lock "cinder-40321293-4637-446b-abaa-4824751d6bc7-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:14:49 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/149c9a9d-da68-4042-8cd2-d6ce95819c49.temp_image.599b2839-8eb1-4c6b-bd7e-643a6f95a5627us7phxt.img /opt/stack/data/cinder/conversion/vol_upload_o3vjvpq3 Jul 09 10:14:49 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ae25a619-543d-4bca-adf5-ed24fbc7963c tempest-VolumeDependencyTests-131698928 None] Acquiring lock "cinder-quobyte-40321293-4637-446b-abaa-4824751d6bc7" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:14:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ae25a619-543d-4bca-adf5-ed24fbc7963c tempest-VolumeDependencyTests-131698928 None] Lock "cinder-quobyte-40321293-4637-446b-abaa-4824751d6bc7" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:14:49 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2221e68e-b0ed-4e02-a75f-360b11d797e1]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:14:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae25a619-543d-4bca-adf5-ed24fbc7963c tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40321293-4637-446b-abaa-4824751d6bc7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:49 devstack sudo[102351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40321293-4637-446b-abaa-4824751d6bc7 Jul 09 10:14:49 devstack sudo[102351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:49 devstack sudo[102344]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b47b0bec-4ccf-412e-af0a-85134b3ec1b7 tempest-VolumeDependencyTests-131698928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.683s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:50 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-b47b0bec-4ccf-412e-af0a-85134b3ec1b7 tempest-VolumeDependencyTests-131698928 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:14:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b47b0bec-4ccf-412e-af0a-85134b3ec1b7 tempest-VolumeDependencyTests-131698928 None] Deleted volume successfully. Jul 09 10:14:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b47b0bec-4ccf-412e-af0a-85134b3ec1b7 tempest-VolumeDependencyTests-131698928 None] Lock "cinder-54885dad-06c6-41a3-8d2f-96da31cba503-delete_volume" released by "delete_volume" :: held 2.536s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:14:50 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/149c9a9d-da68-4042-8cd2-d6ce95819c49.temp_image.599b2839-8eb1-4c6b-bd7e-643a6f95a5627us7phxt.img /opt/stack/data/cinder/conversion/vol_upload_o3vjvpq3" returned: 0 in 0.662s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:50 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] Image conversion details: src /opt/stack/data/cinder/conversion/149c9a9d-da68-4042-8cd2-d6ce95819c49.temp_image.599b2839-8eb1-4c6b-bd7e-643a6f95a5627us7phxt.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_o3vjvpq3 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:14:50 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 09 10:14:50 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b02bc9-92db-4e1f-9fb7-513e59b210ff]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:14:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o3vjvpq3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:50 devstack sudo[102357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o3vjvpq3 Jul 09 10:14:50 devstack sudo[102357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:50 devstack sudo[102351]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae25a619-543d-4bca-adf5-ed24fbc7963c tempest-VolumeDependencyTests-131698928 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40321293-4637-446b-abaa-4824751d6bc7" returned: 0 in 0.825s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae25a619-543d-4bca-adf5-ed24fbc7963c tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40321293-4637-446b-abaa-4824751d6bc7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:50 devstack sudo[102362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40321293-4637-446b-abaa-4824751d6bc7 Jul 09 10:14:50 devstack sudo[102362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:51 devstack sudo[102357]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_o3vjvpq3" returned: 0 in 0.706s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:51 devstack sudo[102362]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae25a619-543d-4bca-adf5-ed24fbc7963c tempest-VolumeDependencyTests-131698928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40321293-4637-446b-abaa-4824751d6bc7" returned: 0 in 0.648s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ae25a619-543d-4bca-adf5-ed24fbc7963c tempest-VolumeDependencyTests-131698928 None] Lock "cinder-quobyte-40321293-4637-446b-abaa-4824751d6bc7" released by "delete_volume" :: held 1.518s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:14:51 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ae25a619-543d-4bca-adf5-ed24fbc7963c tempest-VolumeDependencyTests-131698928 None] Created reservations ['fedc78cd-36cb-4e76-908a-4ecf9922fbce', 'efcd9d71-3354-4de8-bd61-c143c36ec624', '13731c7e-ec0d-4ee7-a0b5-4f8ed0d71805', 'dd9432a6-81ff-4d5f-a376-67213f728f4a'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:14:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ae25a619-543d-4bca-adf5-ed24fbc7963c tempest-VolumeDependencyTests-131698928 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:14:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ae25a619-543d-4bca-adf5-ed24fbc7963c tempest-VolumeDependencyTests-131698928 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:14:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ae25a619-543d-4bca-adf5-ed24fbc7963c tempest-VolumeDependencyTests-131698928 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:14:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ae25a619-543d-4bca-adf5-ed24fbc7963c tempest-VolumeDependencyTests-131698928 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:14:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ae25a619-543d-4bca-adf5-ed24fbc7963c tempest-VolumeDependencyTests-131698928 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:14:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae25a619-543d-4bca-adf5-ed24fbc7963c tempest-VolumeDependencyTests-131698928 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:51 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:14:51 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:52 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae25a619-543d-4bca-adf5-ed24fbc7963c tempest-VolumeDependencyTests-131698928 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.632s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:52 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-ae25a619-543d-4bca-adf5-ed24fbc7963c tempest-VolumeDependencyTests-131698928 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:14:52 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ae25a619-543d-4bca-adf5-ed24fbc7963c tempest-VolumeDependencyTests-131698928 None] Deleted volume successfully. Jul 09 10:14:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ae25a619-543d-4bca-adf5-ed24fbc7963c tempest-VolumeDependencyTests-131698928 None] Lock "cinder-40321293-4637-446b-abaa-4824751d6bc7-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:14:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.257s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:14:52 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] Uploaded volume to glance image-id: 599b2839-8eb1-4c6b-bd7e-643a6f95a562. {{(pid=87192) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 09 10:14:52 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-bbd748d3-df0f-45fb-b4cc-af09b76047eb tempest-VolumesActionsTest-1158003976 None] Copy volume to image completed successfully. Jul 09 10:14:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ae4d9317-5c25-4268-8840-5112238b5352 tempest-VolumesActionsTest-1158003976 None] Acquiring lock "cinder-149c9a9d-da68-4042-8cd2-d6ce95819c49-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:14:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ae4d9317-5c25-4268-8840-5112238b5352 tempest-VolumesActionsTest-1158003976 None] Lock "cinder-149c9a9d-da68-4042-8cd2-d6ce95819c49-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:14:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ae4d9317-5c25-4268-8840-5112238b5352 tempest-VolumesActionsTest-1158003976 None] Acquiring lock "cinder-quobyte-149c9a9d-da68-4042-8cd2-d6ce95819c49" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:14:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ae4d9317-5c25-4268-8840-5112238b5352 tempest-VolumesActionsTest-1158003976 None] Lock "cinder-quobyte-149c9a9d-da68-4042-8cd2-d6ce95819c49" acquired by "delete_volume" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:14:54 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb91a5c7-9155-441d-9e99-b9f19d1bd4d8]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:14:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae4d9317-5c25-4268-8840-5112238b5352 tempest-VolumesActionsTest-1158003976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:54 devstack sudo[102372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 Jul 09 10:14:54 devstack sudo[102372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:54 devstack sudo[102372]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae4d9317-5c25-4268-8840-5112238b5352 tempest-VolumesActionsTest-1158003976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49" returned: 0 in 0.739s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae4d9317-5c25-4268-8840-5112238b5352 tempest-VolumesActionsTest-1158003976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:54 devstack sudo[102378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49 Jul 09 10:14:54 devstack sudo[102378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:55 devstack sudo[102378]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae4d9317-5c25-4268-8840-5112238b5352 tempest-VolumesActionsTest-1158003976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-149c9a9d-da68-4042-8cd2-d6ce95819c49" returned: 0 in 0.627s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ae4d9317-5c25-4268-8840-5112238b5352 tempest-VolumesActionsTest-1158003976 None] Lock "cinder-quobyte-149c9a9d-da68-4042-8cd2-d6ce95819c49" released by "delete_volume" :: held 1.410s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:14:55 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ae4d9317-5c25-4268-8840-5112238b5352 tempest-VolumesActionsTest-1158003976 None] Created reservations ['466af24c-682d-4bc9-9acd-5c72eb44b355', 'ddc127a7-3c67-4bdf-b9f8-932d5f29cb9d', '04f0d9b2-3b4d-406a-8557-c611d7f37401', '77bde0d6-a092-499d-84b4-13378150fac9'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:14:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ae4d9317-5c25-4268-8840-5112238b5352 tempest-VolumesActionsTest-1158003976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:14:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ae4d9317-5c25-4268-8840-5112238b5352 tempest-VolumesActionsTest-1158003976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:14:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ae4d9317-5c25-4268-8840-5112238b5352 tempest-VolumesActionsTest-1158003976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:14:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ae4d9317-5c25-4268-8840-5112238b5352 tempest-VolumesActionsTest-1158003976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:14:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ae4d9317-5c25-4268-8840-5112238b5352 tempest-VolumesActionsTest-1158003976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:14:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae4d9317-5c25-4268-8840-5112238b5352 tempest-VolumesActionsTest-1158003976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:14:55 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:14:55 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:14:56 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Jul 09 10:14:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ae4d9317-5c25-4268-8840-5112238b5352 tempest-VolumesActionsTest-1158003976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.680s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:14:56 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-ae4d9317-5c25-4268-8840-5112238b5352 tempest-VolumesActionsTest-1158003976 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:14:56 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ae4d9317-5c25-4268-8840-5112238b5352 tempest-VolumesActionsTest-1158003976 None] Deleted volume successfully. Jul 09 10:14:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ae4d9317-5c25-4268-8840-5112238b5352 tempest-VolumesActionsTest-1158003976 None] Lock "cinder-149c9a9d-da68-4042-8cd2-d6ce95819c49-delete_volume" released by "delete_volume" :: held 2.321s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:14:59 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Flow 'volume_create_manager' (d9e1b7fe-139c-46ec-a177-7164b5cb3ea1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1701b1d3-90f1-4920-96bb-a3ccf472dd6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1701b1d3-90f1-4920-96bb-a3ccf472dd6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-329269443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c3fb96-ad70-46ec-9851-f05b7a617392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef163eddabb406ab514610c6fd7914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:15:00Z,use_quota=True,user_id='aff2dee11b704df5b66e6ca740bc9213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfaf1bdf-27a4-4de8-b373-c29360e8d998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dfaf1bdf-27a4-4de8-b373-c29360e8d998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b604ea0-e838-4a8a-b150-b230a477ecd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7b604ea0-e838-4a8a-b150-b230a477ecd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26c3fb96-ad70-46ec-9851-f05b7a617392', 'volume_name': 'volume-26c3fb96-ad70-46ec-9851-f05b7a617392', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63af6f8-78f6-46fa-b9ac-dd029c7f2172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e63af6f8-78f6-46fa-b9ac-dd029c7f2172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7606103-d5e5-40eb-b7b2-22b627958014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:00 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Volume 26c3fb96-ad70-46ec-9851-f05b7a617392: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26c3fb96-ad70-46ec-9851-f05b7a617392', 'volume_size': 1} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:15:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-329269443',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26c3fb96-ad70-46ec-9851-f05b7a617392,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef163eddabb406ab514610c6fd7914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:15:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:15:00Z,use_quota=True,user_id='aff2dee11b704df5b66e6ca740bc9213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Creating volume 26c3fb96-ad70-46ec-9851-f05b7a617392 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:15:00 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-26c3fb96-ad70-46ec-9851-f05b7a617392 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:00 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-26c3fb96-ad70-46ec-9851-f05b7a617392 1073741824 Jul 09 10:15:00 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:00 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-26c3fb96-ad70-46ec-9851-f05b7a617392 1073741824" returned: 0 in 0.852s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-26c3fb96-ad70-46ec-9851-f05b7a617392 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:01 devstack sudo[102393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-26c3fb96-ad70-46ec-9851-f05b7a617392 Jul 09 10:15:01 devstack sudo[102393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:01 devstack sudo[102393]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-26c3fb96-ad70-46ec-9851-f05b7a617392" returned: 0 in 0.675s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] <== create_volume: return (1584ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:15:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.586s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7606103-d5e5-40eb-b7b2-22b627958014) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26c3fb96-ad70-46ec-9851-f05b7a617392', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf1baaa-dbc5-43c6-bf98-8230656e98e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:01 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Volume volume-26c3fb96-ad70-46ec-9851-f05b7a617392 (26c3fb96-ad70-46ec-9851-f05b7a617392): created successfully Jul 09 10:15:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cf1baaa-dbc5-43c6-bf98-8230656e98e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:01 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Flow 'volume_create_manager' (d9e1b7fe-139c-46ec-a177-7164b5cb3ea1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:15:01 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-03cdfb1d-935e-4660-8c5d-ae1c76aa1149 tempest-ProjectReaderTests-1938698804 None] Created volume successfully. Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Flow 'volume_create_manager' (d9075f17-ce19-4b08-ab70-2dcfa7c15e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b810bc34-3282-4345-9000-58a143b8dc99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e85bc790-8e60-4d67-9139-2221f1ec587c tempest-ProjectReaderTests-1938698804 None] Acquiring lock "cinder-26c3fb96-ad70-46ec-9851-f05b7a617392-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b810bc34-3282-4345-9000-58a143b8dc99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1519116431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f28b84-4cf9-4c9a-940e-7ed0278491d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac0733bb17c145f5b4c3e91f6cb081af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:15:02Z,use_quota=True,user_id='7e8e6943eb3345c688c20e0690078e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f741159e-c831-406d-8d00-a865b3ed5cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f741159e-c831-406d-8d00-a865b3ed5cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deee75f8-1849-4797-875b-e01be758fce3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deee75f8-1849-4797-875b-e01be758fce3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58f28b84-4cf9-4c9a-940e-7ed0278491d2', 'volume_name': 'volume-58f28b84-4cf9-4c9a-940e-7ed0278491d2', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29005f89-2626-451f-acd9-1627e8b3aced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29005f89-2626-451f-acd9-1627e8b3aced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a703395c-8991-4128-ac84-8024f98b4f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:02 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Volume 58f28b84-4cf9-4c9a-940e-7ed0278491d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58f28b84-4cf9-4c9a-940e-7ed0278491d2', 'volume_size': 1} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1519116431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58f28b84-4cf9-4c9a-940e-7ed0278491d2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac0733bb17c145f5b4c3e91f6cb081af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:15:02Z,use_quota=True,user_id='7e8e6943eb3345c688c20e0690078e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Creating volume 58f28b84-4cf9-4c9a-940e-7ed0278491d2 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:15:02 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-58f28b84-4cf9-4c9a-940e-7ed0278491d2 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e85bc790-8e60-4d67-9139-2221f1ec587c tempest-ProjectReaderTests-1938698804 None] Lock "cinder-26c3fb96-ad70-46ec-9851-f05b7a617392-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:15:02 devstack sudo[102400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-58f28b84-4cf9-4c9a-940e-7ed0278491d2 1073741824 Jul 09 10:15:02 devstack sudo[102400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e85bc790-8e60-4d67-9139-2221f1ec587c tempest-ProjectReaderTests-1938698804 None] Acquiring lock "cinder-quobyte-26c3fb96-ad70-46ec-9851-f05b7a617392" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e85bc790-8e60-4d67-9139-2221f1ec587c tempest-ProjectReaderTests-1938698804 None] Lock "cinder-quobyte-26c3fb96-ad70-46ec-9851-f05b7a617392" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da52fa0-c82a-4e61-bd61-27dd7414101e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:15:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e85bc790-8e60-4d67-9139-2221f1ec587c tempest-ProjectReaderTests-1938698804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-26c3fb96-ad70-46ec-9851-f05b7a617392 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:02 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-26c3fb96-ad70-46ec-9851-f05b7a617392 Jul 09 10:15:02 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:03 devstack sudo[102400]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-58f28b84-4cf9-4c9a-940e-7ed0278491d2 1073741824" returned: 0 in 0.816s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-58f28b84-4cf9-4c9a-940e-7ed0278491d2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:03 devstack sudo[102410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-58f28b84-4cf9-4c9a-940e-7ed0278491d2 Jul 09 10:15:03 devstack sudo[102410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:03 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e85bc790-8e60-4d67-9139-2221f1ec587c tempest-ProjectReaderTests-1938698804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-26c3fb96-ad70-46ec-9851-f05b7a617392" returned: 0 in 0.805s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e85bc790-8e60-4d67-9139-2221f1ec587c tempest-ProjectReaderTests-1938698804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-26c3fb96-ad70-46ec-9851-f05b7a617392 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:03 devstack sudo[102412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-26c3fb96-ad70-46ec-9851-f05b7a617392 Jul 09 10:15:03 devstack sudo[102412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:03 devstack sudo[102410]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-58f28b84-4cf9-4c9a-940e-7ed0278491d2" returned: 0 in 0.650s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:15:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a703395c-8991-4128-ac84-8024f98b4f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58f28b84-4cf9-4c9a-940e-7ed0278491d2', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abbb3f5f-fcd0-4778-aea0-d00cb21a9f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:03 devstack sudo[102412]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e85bc790-8e60-4d67-9139-2221f1ec587c tempest-ProjectReaderTests-1938698804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-26c3fb96-ad70-46ec-9851-f05b7a617392" returned: 0 in 0.643s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:03 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Volume volume-58f28b84-4cf9-4c9a-940e-7ed0278491d2 (58f28b84-4cf9-4c9a-940e-7ed0278491d2): created successfully Jul 09 10:15:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (abbb3f5f-fcd0-4778-aea0-d00cb21a9f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Flow 'volume_create_manager' (d9075f17-ce19-4b08-ab70-2dcfa7c15e6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:15:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e85bc790-8e60-4d67-9139-2221f1ec587c tempest-ProjectReaderTests-1938698804 None] Lock "cinder-quobyte-26c3fb96-ad70-46ec-9851-f05b7a617392" released by "delete_volume" :: held 1.499s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:15:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b7743a79-1774-419f-88d3-f5623c686087 tempest-VolumesListTestJSON-1626612204 None] Created volume successfully. Jul 09 10:15:03 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-e85bc790-8e60-4d67-9139-2221f1ec587c tempest-ProjectReaderTests-1938698804 None] Created reservations ['776c46cd-e61b-4f2b-a0dd-eb9c63e7db12', '3e045269-f791-4dfc-bf1b-ca730d2df0f9', '72a6c213-0b29-4063-ac37-5850dddd6ee4', 'd44d6372-319c-4df8-a612-6519a918cd3c'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:15:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e85bc790-8e60-4d67-9139-2221f1ec587c tempest-ProjectReaderTests-1938698804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e85bc790-8e60-4d67-9139-2221f1ec587c tempest-ProjectReaderTests-1938698804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e85bc790-8e60-4d67-9139-2221f1ec587c tempest-ProjectReaderTests-1938698804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:15:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e85bc790-8e60-4d67-9139-2221f1ec587c tempest-ProjectReaderTests-1938698804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:15:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e85bc790-8e60-4d67-9139-2221f1ec587c tempest-ProjectReaderTests-1938698804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e85bc790-8e60-4d67-9139-2221f1ec587c tempest-ProjectReaderTests-1938698804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:04 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:15:04 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:04 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e85bc790-8e60-4d67-9139-2221f1ec587c tempest-ProjectReaderTests-1938698804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.685s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-e85bc790-8e60-4d67-9139-2221f1ec587c tempest-ProjectReaderTests-1938698804 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:15:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e85bc790-8e60-4d67-9139-2221f1ec587c tempest-ProjectReaderTests-1938698804 None] Deleted volume successfully. Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Flow 'volume_create_manager' (56b1b09f-1871-4325-8423-1e41bcc95dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8be671-857c-4695-934c-6ea77b7fc454) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e85bc790-8e60-4d67-9139-2221f1ec587c tempest-ProjectReaderTests-1938698804 None] Lock "cinder-26c3fb96-ad70-46ec-9851-f05b7a617392-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c8be671-857c-4695-934c-6ea77b7fc454) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-907682814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53321f3a-e900-4811-937c-3890185591bf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac0733bb17c145f5b4c3e91f6cb081af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:15:05Z,use_quota=True,user_id='7e8e6943eb3345c688c20e0690078e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52df46a7-d61b-4bde-886c-d20fd7ecdfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (52df46a7-d61b-4bde-886c-d20fd7ecdfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69c4eb6-5c4f-4441-b57a-cc76c078742f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e69c4eb6-5c4f-4441-b57a-cc76c078742f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '53321f3a-e900-4811-937c-3890185591bf', 'volume_name': 'volume-53321f3a-e900-4811-937c-3890185591bf', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0fe041-d430-4bc7-9b60-5714f90cc68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec0fe041-d430-4bc7-9b60-5714f90cc68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40660841-4436-4c15-a761-5c6cef58f7f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:04 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Volume 53321f3a-e900-4811-937c-3890185591bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-53321f3a-e900-4811-937c-3890185591bf', 'volume_size': 1} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:15:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-907682814',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=53321f3a-e900-4811-937c-3890185591bf,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac0733bb17c145f5b4c3e91f6cb081af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:15:05Z,use_quota=True,user_id='7e8e6943eb3345c688c20e0690078e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Creating volume 53321f3a-e900-4811-937c-3890185591bf {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:15:04 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-53321f3a-e900-4811-937c-3890185591bf 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:04 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-53321f3a-e900-4811-937c-3890185591bf 1073741824 Jul 09 10:15:04 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Flow 'volume_create_manager' (573ba274-978f-4a40-a127-59f6f4dde964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ae5c92-4a35-49d1-811b-72be9a9a09b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98ae5c92-4a35-49d1-811b-72be9a9a09b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-70242859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c2bd71f-a4f1-442d-9ed0-9c429a58a478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef163eddabb406ab514610c6fd7914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:15:05Z,use_quota=True,user_id='aff2dee11b704df5b66e6ca740bc9213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf49a6a-95fa-48d3-904a-3cb57cae9e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bf49a6a-95fa-48d3-904a-3cb57cae9e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9491f525-6e15-4298-9654-e9c7869d0ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9491f525-6e15-4298-9654-e9c7869d0ec0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c2bd71f-a4f1-442d-9ed0-9c429a58a478', 'volume_name': 'volume-3c2bd71f-a4f1-442d-9ed0-9c429a58a478', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f35a7c-c0a1-4597-b381-b84ded0ab798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05f35a7c-c0a1-4597-b381-b84ded0ab798) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02698ffd-40a0-428a-86e5-2649dbf3a489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:05 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Volume 3c2bd71f-a4f1-442d-9ed0-9c429a58a478: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c2bd71f-a4f1-442d-9ed0-9c429a58a478', 'volume_size': 1} Jul 09 10:15:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:05 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-53321f3a-e900-4811-937c-3890185591bf 1073741824" returned: 0 in 0.787s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-53321f3a-e900-4811-937c-3890185591bf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:05 devstack sudo[102426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-53321f3a-e900-4811-937c-3890185591bf Jul 09 10:15:05 devstack sudo[102426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:06 devstack sudo[102426]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-53321f3a-e900-4811-937c-3890185591bf" returned: 0 in 0.641s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] <== create_volume: return (1465ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:15:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.278s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:15:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-70242859',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c2bd71f-a4f1-442d-9ed0-9c429a58a478,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef163eddabb406ab514610c6fd7914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:15:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:15:05Z,use_quota=True,user_id='aff2dee11b704df5b66e6ca740bc9213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:15:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Creating volume 3c2bd71f-a4f1-442d-9ed0-9c429a58a478 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:15:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:15:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:15:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:15:06 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:15:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3c2bd71f-a4f1-442d-9ed0-9c429a58a478 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40660841-4436-4c15-a761-5c6cef58f7f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-53321f3a-e900-4811-937c-3890185591bf', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:06 devstack sudo[102429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3c2bd71f-a4f1-442d-9ed0-9c429a58a478 1073741824 Jul 09 10:15:06 devstack sudo[102429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c4481d-da1c-474d-9839-facc5c91dac8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:06 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Volume volume-53321f3a-e900-4811-937c-3890185591bf (53321f3a-e900-4811-937c-3890185591bf): created successfully Jul 09 10:15:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0c4481d-da1c-474d-9839-facc5c91dac8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Flow 'volume_create_manager' (56b1b09f-1871-4325-8423-1e41bcc95dd4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:15:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8a834a24-7fb2-4543-a321-28fcd8d5860b tempest-VolumesListTestJSON-1626612204 None] Created volume successfully. Jul 09 10:15:07 devstack sudo[102429]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3c2bd71f-a4f1-442d-9ed0-9c429a58a478 1073741824" returned: 0 in 0.867s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3c2bd71f-a4f1-442d-9ed0-9c429a58a478 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:15:07 devstack sudo[102435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3c2bd71f-a4f1-442d-9ed0-9c429a58a478 Jul 09 10:15:07 devstack sudo[102435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Flow 'volume_create_manager' (dffdfbd9-dd4f-4bab-8dff-685a154eee05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f23012-f66b-4375-8e20-cba7f4c70815) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2f23012-f66b-4375-8e20-cba7f4c70815) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1119844306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb0960f-a20f-4ff4-9e77-69a970fdd411,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac0733bb17c145f5b4c3e91f6cb081af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:15:07Z,use_quota=True,user_id='7e8e6943eb3345c688c20e0690078e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be658d94-af62-4a0a-af2d-9550e1e15254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be658d94-af62-4a0a-af2d-9550e1e15254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e0a115-6ca0-4314-8e8b-23cd28bc73f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64e0a115-6ca0-4314-8e8b-23cd28bc73f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aeb0960f-a20f-4ff4-9e77-69a970fdd411', 'volume_name': 'volume-aeb0960f-a20f-4ff4-9e77-69a970fdd411', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5413f311-e346-4dbb-bd8e-82e40499d9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5413f311-e346-4dbb-bd8e-82e40499d9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4afddb37-f64d-4a76-b2fc-ae63ee150ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:07 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Volume aeb0960f-a20f-4ff4-9e77-69a970fdd411: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aeb0960f-a20f-4ff4-9e77-69a970fdd411', 'volume_size': 1} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:07 devstack sudo[102435]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3c2bd71f-a4f1-442d-9ed0-9c429a58a478" returned: 0 in 0.623s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] <== create_volume: return (1548ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.551s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.522s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1119844306',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aeb0960f-a20f-4ff4-9e77-69a970fdd411,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ac0733bb17c145f5b4c3e91f6cb081af',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:15:07Z,use_quota=True,user_id='7e8e6943eb3345c688c20e0690078e68',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Creating volume aeb0960f-a20f-4ff4-9e77-69a970fdd411 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:15:07 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-aeb0960f-a20f-4ff4-9e77-69a970fdd411 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02698ffd-40a0-428a-86e5-2649dbf3a489) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c2bd71f-a4f1-442d-9ed0-9c429a58a478', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb6f135-359b-4271-91d1-cd677e9b976d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:07 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-aeb0960f-a20f-4ff4-9e77-69a970fdd411 1073741824 Jul 09 10:15:07 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:07 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Volume volume-3c2bd71f-a4f1-442d-9ed0-9c429a58a478 (3c2bd71f-a4f1-442d-9ed0-9c429a58a478): created successfully Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccb6f135-359b-4271-91d1-cd677e9b976d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Flow 'volume_create_manager' (573ba274-978f-4a40-a127-59f6f4dde964) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:15:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-25b9b43c-9563-4d8f-a72d-9045a28ece84 tempest-ProjectReaderTests-1938698804 None] Created volume successfully. Jul 09 10:15:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-92231944-d766-4c87-956d-eb594a8baa3f tempest-ProjectReaderTests-1938698804 None] Acquiring lock "cinder-3c2bd71f-a4f1-442d-9ed0-9c429a58a478-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:15:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-92231944-d766-4c87-956d-eb594a8baa3f tempest-ProjectReaderTests-1938698804 None] Lock "cinder-3c2bd71f-a4f1-442d-9ed0-9c429a58a478-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:15:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-92231944-d766-4c87-956d-eb594a8baa3f tempest-ProjectReaderTests-1938698804 None] Acquiring lock "cinder-quobyte-3c2bd71f-a4f1-442d-9ed0-9c429a58a478" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:15:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-92231944-d766-4c87-956d-eb594a8baa3f tempest-ProjectReaderTests-1938698804 None] Lock "cinder-quobyte-3c2bd71f-a4f1-442d-9ed0-9c429a58a478" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:15:08 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0054cb34-f488-47e5-8de3-a45a4ac6555e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:15:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92231944-d766-4c87-956d-eb594a8baa3f tempest-ProjectReaderTests-1938698804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3c2bd71f-a4f1-442d-9ed0-9c429a58a478 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:08 devstack sudo[102441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3c2bd71f-a4f1-442d-9ed0-9c429a58a478 Jul 09 10:15:08 devstack sudo[102441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:08 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-aeb0960f-a20f-4ff4-9e77-69a970fdd411 1073741824" returned: 0 in 0.798s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-aeb0960f-a20f-4ff4-9e77-69a970fdd411 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:08 devstack sudo[102446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-aeb0960f-a20f-4ff4-9e77-69a970fdd411 Jul 09 10:15:08 devstack sudo[102446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:09 devstack sudo[102441]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92231944-d766-4c87-956d-eb594a8baa3f tempest-ProjectReaderTests-1938698804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3c2bd71f-a4f1-442d-9ed0-9c429a58a478" returned: 0 in 0.770s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92231944-d766-4c87-956d-eb594a8baa3f tempest-ProjectReaderTests-1938698804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3c2bd71f-a4f1-442d-9ed0-9c429a58a478 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:09 devstack sudo[102451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3c2bd71f-a4f1-442d-9ed0-9c429a58a478 Jul 09 10:15:09 devstack sudo[102451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:09 devstack sudo[102446]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-aeb0960f-a20f-4ff4-9e77-69a970fdd411" returned: 0 in 0.634s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:15:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.476s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4afddb37-f64d-4a76-b2fc-ae63ee150ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aeb0960f-a20f-4ff4-9e77-69a970fdd411', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4260affd-ca71-4c49-ad2a-5e17e6a62c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:09 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Volume volume-aeb0960f-a20f-4ff4-9e77-69a970fdd411 (aeb0960f-a20f-4ff4-9e77-69a970fdd411): created successfully Jul 09 10:15:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4260affd-ca71-4c49-ad2a-5e17e6a62c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Flow 'volume_create_manager' (dffdfbd9-dd4f-4bab-8dff-685a154eee05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:15:09 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8d0e06b8-f5b2-45b3-94f9-0a722f44d1f7 tempest-VolumesListTestJSON-1626612204 None] Created volume successfully. Jul 09 10:15:09 devstack sudo[102451]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92231944-d766-4c87-956d-eb594a8baa3f tempest-ProjectReaderTests-1938698804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3c2bd71f-a4f1-442d-9ed0-9c429a58a478" returned: 0 in 0.660s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-92231944-d766-4c87-956d-eb594a8baa3f tempest-ProjectReaderTests-1938698804 None] Lock "cinder-quobyte-3c2bd71f-a4f1-442d-9ed0-9c429a58a478" released by "delete_volume" :: held 1.469s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:15:09 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-92231944-d766-4c87-956d-eb594a8baa3f tempest-ProjectReaderTests-1938698804 None] Created reservations ['6fb1c6f3-53f9-43cc-90a0-7eae5ed8c2da', '33c32193-6540-4c38-a4f8-c5fdad6f92e4', '30cd44ab-0f82-42d2-9d7d-4bfc7dc0e649', '3c3f65b4-86ed-4c20-80c4-4ccd5fe44a3c'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:15:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-92231944-d766-4c87-956d-eb594a8baa3f tempest-ProjectReaderTests-1938698804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-92231944-d766-4c87-956d-eb594a8baa3f tempest-ProjectReaderTests-1938698804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-92231944-d766-4c87-956d-eb594a8baa3f tempest-ProjectReaderTests-1938698804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:15:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-92231944-d766-4c87-956d-eb594a8baa3f tempest-ProjectReaderTests-1938698804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:15:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-92231944-d766-4c87-956d-eb594a8baa3f tempest-ProjectReaderTests-1938698804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92231944-d766-4c87-956d-eb594a8baa3f tempest-ProjectReaderTests-1938698804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:09 devstack sudo[102455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:15:09 devstack sudo[102455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:10 devstack sudo[102455]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92231944-d766-4c87-956d-eb594a8baa3f tempest-ProjectReaderTests-1938698804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.632s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-92231944-d766-4c87-956d-eb594a8baa3f tempest-ProjectReaderTests-1938698804 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:15:10 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-92231944-d766-4c87-956d-eb594a8baa3f tempest-ProjectReaderTests-1938698804 None] Deleted volume successfully. Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-92231944-d766-4c87-956d-eb594a8baa3f tempest-ProjectReaderTests-1938698804 None] Lock "cinder-3c2bd71f-a4f1-442d-9ed0-9c429a58a478-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Flow 'volume_create_manager' (a0c92f02-20e5-4594-af8b-d119f02b6d45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e3f02b-8812-4296-862b-ca89e165352a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12e3f02b-8812-4296-862b-ca89e165352a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1464143352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3675370f-38ac-4ddb-b06f-d6c531fc0076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef163eddabb406ab514610c6fd7914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:15:11Z,use_quota=True,user_id='aff2dee11b704df5b66e6ca740bc9213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ef8809-806f-453b-a9b9-000539c64bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d4ef8809-806f-453b-a9b9-000539c64bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bcfb313-1b45-4eed-883a-1e416b095225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bcfb313-1b45-4eed-883a-1e416b095225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3675370f-38ac-4ddb-b06f-d6c531fc0076', 'volume_name': 'volume-3675370f-38ac-4ddb-b06f-d6c531fc0076', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3876b2c4-73b6-4b92-8b41-144c216b92d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3876b2c4-73b6-4b92-8b41-144c216b92d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c630cf-0c1c-4ff4-9a3d-f70e65a22750) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:10 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Volume 3675370f-38ac-4ddb-b06f-d6c531fc0076: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3675370f-38ac-4ddb-b06f-d6c531fc0076', 'volume_size': 1} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:15:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1464143352',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3675370f-38ac-4ddb-b06f-d6c531fc0076,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef163eddabb406ab514610c6fd7914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:15:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:15:11Z,use_quota=True,user_id='aff2dee11b704df5b66e6ca740bc9213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Creating volume 3675370f-38ac-4ddb-b06f-d6c531fc0076 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:15:10 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:15:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3675370f-38ac-4ddb-b06f-d6c531fc0076 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:10 devstack sudo[102458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3675370f-38ac-4ddb-b06f-d6c531fc0076 1073741824 Jul 09 10:15:10 devstack sudo[102458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:11 devstack sudo[102458]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3675370f-38ac-4ddb-b06f-d6c531fc0076 1073741824" returned: 0 in 0.868s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3675370f-38ac-4ddb-b06f-d6c531fc0076 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:11 devstack sudo[102464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3675370f-38ac-4ddb-b06f-d6c531fc0076 Jul 09 10:15:11 devstack sudo[102464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e518f790-4a9b-4521-bb9f-da2019f885c2 tempest-VolumesListTestJSON-1626612204 None] Acquiring lock "cinder-aeb0960f-a20f-4ff4-9e77-69a970fdd411-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:15:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e518f790-4a9b-4521-bb9f-da2019f885c2 tempest-VolumesListTestJSON-1626612204 None] Lock "cinder-aeb0960f-a20f-4ff4-9e77-69a970fdd411-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:15:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e518f790-4a9b-4521-bb9f-da2019f885c2 tempest-VolumesListTestJSON-1626612204 None] Acquiring lock "cinder-quobyte-aeb0960f-a20f-4ff4-9e77-69a970fdd411" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:15:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e518f790-4a9b-4521-bb9f-da2019f885c2 tempest-VolumesListTestJSON-1626612204 None] Lock "cinder-quobyte-aeb0960f-a20f-4ff4-9e77-69a970fdd411" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:15:12 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b80cb6b-c36a-4972-8f7c-b97d43e06b21]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:15:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e518f790-4a9b-4521-bb9f-da2019f885c2 tempest-VolumesListTestJSON-1626612204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-aeb0960f-a20f-4ff4-9e77-69a970fdd411 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:12 devstack sudo[102464]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3675370f-38ac-4ddb-b06f-d6c531fc0076" returned: 0 in 0.636s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] <== create_volume: return (1550ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:15:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.553s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94c630cf-0c1c-4ff4-9a3d-f70e65a22750) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3675370f-38ac-4ddb-b06f-d6c531fc0076', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dccdfaac-aa28-43b3-8fac-29f50fb44a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:12 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Volume volume-3675370f-38ac-4ddb-b06f-d6c531fc0076 (3675370f-38ac-4ddb-b06f-d6c531fc0076): created successfully Jul 09 10:15:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dccdfaac-aa28-43b3-8fac-29f50fb44a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:12 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Flow 'volume_create_manager' (a0c92f02-20e5-4594-af8b-d119f02b6d45) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:15:12 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-213f6d3f-7a6d-4840-b806-7de7d879b688 tempest-ProjectReaderTests-1938698804 None] Created volume successfully. Jul 09 10:15:12 devstack sudo[102467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-aeb0960f-a20f-4ff4-9e77-69a970fdd411 Jul 09 10:15:12 devstack sudo[102467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5c8ac394-596a-4c17-bdeb-be6190b62db9 tempest-ProjectReaderTests-1938698804 None] Acquiring lock "cinder-3675370f-38ac-4ddb-b06f-d6c531fc0076-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:15:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5c8ac394-596a-4c17-bdeb-be6190b62db9 tempest-ProjectReaderTests-1938698804 None] Lock "cinder-3675370f-38ac-4ddb-b06f-d6c531fc0076-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:15:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5c8ac394-596a-4c17-bdeb-be6190b62db9 tempest-ProjectReaderTests-1938698804 None] Acquiring lock "cinder-quobyte-3675370f-38ac-4ddb-b06f-d6c531fc0076" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:15:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5c8ac394-596a-4c17-bdeb-be6190b62db9 tempest-ProjectReaderTests-1938698804 None] Lock "cinder-quobyte-3675370f-38ac-4ddb-b06f-d6c531fc0076" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:15:13 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb7701da-a02b-4911-8f57-470480417926]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:15:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5c8ac394-596a-4c17-bdeb-be6190b62db9 tempest-ProjectReaderTests-1938698804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3675370f-38ac-4ddb-b06f-d6c531fc0076 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:13 devstack sudo[102471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3675370f-38ac-4ddb-b06f-d6c531fc0076 Jul 09 10:15:13 devstack sudo[102471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:13 devstack sudo[102467]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e518f790-4a9b-4521-bb9f-da2019f885c2 tempest-VolumesListTestJSON-1626612204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-aeb0960f-a20f-4ff4-9e77-69a970fdd411" returned: 0 in 0.770s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e518f790-4a9b-4521-bb9f-da2019f885c2 tempest-VolumesListTestJSON-1626612204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-aeb0960f-a20f-4ff4-9e77-69a970fdd411 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:13 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-aeb0960f-a20f-4ff4-9e77-69a970fdd411 Jul 09 10:15:13 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:13 devstack sudo[102471]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5c8ac394-596a-4c17-bdeb-be6190b62db9 tempest-ProjectReaderTests-1938698804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3675370f-38ac-4ddb-b06f-d6c531fc0076" returned: 0 in 0.769s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5c8ac394-596a-4c17-bdeb-be6190b62db9 tempest-ProjectReaderTests-1938698804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3675370f-38ac-4ddb-b06f-d6c531fc0076 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:13 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e518f790-4a9b-4521-bb9f-da2019f885c2 tempest-VolumesListTestJSON-1626612204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-aeb0960f-a20f-4ff4-9e77-69a970fdd411" returned: 0 in 0.647s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:13 devstack sudo[102480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3675370f-38ac-4ddb-b06f-d6c531fc0076 Jul 09 10:15:13 devstack sudo[102480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e518f790-4a9b-4521-bb9f-da2019f885c2 tempest-VolumesListTestJSON-1626612204 None] Lock "cinder-quobyte-aeb0960f-a20f-4ff4-9e77-69a970fdd411" released by "delete_volume" :: held 1.458s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:15:13 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-e518f790-4a9b-4521-bb9f-da2019f885c2 tempest-VolumesListTestJSON-1626612204 None] Created reservations ['2c42e159-e681-48e3-8fa3-d44fcfbab614', '63970095-9833-4071-bc6a-bb63e030a560', 'adfc873a-97e2-4a21-8e50-a694fcb26f42', '77223c15-6820-4e7f-9908-3295faf40579'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e518f790-4a9b-4521-bb9f-da2019f885c2 tempest-VolumesListTestJSON-1626612204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e518f790-4a9b-4521-bb9f-da2019f885c2 tempest-VolumesListTestJSON-1626612204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e518f790-4a9b-4521-bb9f-da2019f885c2 tempest-VolumesListTestJSON-1626612204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e518f790-4a9b-4521-bb9f-da2019f885c2 tempest-VolumesListTestJSON-1626612204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e518f790-4a9b-4521-bb9f-da2019f885c2 tempest-VolumesListTestJSON-1626612204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e518f790-4a9b-4521-bb9f-da2019f885c2 tempest-VolumesListTestJSON-1626612204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:14 devstack sudo[102482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:15:14 devstack sudo[102482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:14 devstack sudo[102480]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5c8ac394-596a-4c17-bdeb-be6190b62db9 tempest-ProjectReaderTests-1938698804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3675370f-38ac-4ddb-b06f-d6c531fc0076" returned: 0 in 0.644s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5c8ac394-596a-4c17-bdeb-be6190b62db9 tempest-ProjectReaderTests-1938698804 None] Lock "cinder-quobyte-3675370f-38ac-4ddb-b06f-d6c531fc0076" released by "delete_volume" :: held 1.460s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-5c8ac394-596a-4c17-bdeb-be6190b62db9 tempest-ProjectReaderTests-1938698804 None] Created reservations ['ac389e54-df60-4a66-a620-f139f6c3c637', '8552579f-8ef1-4448-84af-bdc3ff2a3e78', '312f26f3-c08c-4579-9505-39ceb7ed0b7a', 'e15adcdd-0a29-4e08-8397-55b53bb84166'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-130b438f-eaf6-4de2-aea9-c072f1dba85c tempest-VolumesListTestJSON-1626612204 None] Acquiring lock "cinder-53321f3a-e900-4811-937c-3890185591bf-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5c8ac394-596a-4c17-bdeb-be6190b62db9 tempest-ProjectReaderTests-1938698804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5c8ac394-596a-4c17-bdeb-be6190b62db9 tempest-ProjectReaderTests-1938698804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5c8ac394-596a-4c17-bdeb-be6190b62db9 tempest-ProjectReaderTests-1938698804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5c8ac394-596a-4c17-bdeb-be6190b62db9 tempest-ProjectReaderTests-1938698804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5c8ac394-596a-4c17-bdeb-be6190b62db9 tempest-ProjectReaderTests-1938698804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5c8ac394-596a-4c17-bdeb-be6190b62db9 tempest-ProjectReaderTests-1938698804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-130b438f-eaf6-4de2-aea9-c072f1dba85c tempest-VolumesListTestJSON-1626612204 None] Lock "cinder-53321f3a-e900-4811-937c-3890185591bf-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:15:14 devstack sudo[102482]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:14 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:15:14 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e518f790-4a9b-4521-bb9f-da2019f885c2 tempest-VolumesListTestJSON-1626612204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.716s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-e518f790-4a9b-4521-bb9f-da2019f885c2 tempest-VolumesListTestJSON-1626612204 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:15:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e518f790-4a9b-4521-bb9f-da2019f885c2 tempest-VolumesListTestJSON-1626612204 None] Deleted volume successfully. Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e518f790-4a9b-4521-bb9f-da2019f885c2 tempest-VolumesListTestJSON-1626612204 None] Lock "cinder-aeb0960f-a20f-4ff4-9e77-69a970fdd411-delete_volume" released by "delete_volume" :: held 2.376s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-130b438f-eaf6-4de2-aea9-c072f1dba85c tempest-VolumesListTestJSON-1626612204 None] Acquiring lock "cinder-quobyte-53321f3a-e900-4811-937c-3890185591bf" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-130b438f-eaf6-4de2-aea9-c072f1dba85c tempest-VolumesListTestJSON-1626612204 None] Lock "cinder-quobyte-53321f3a-e900-4811-937c-3890185591bf" acquired by "delete_volume" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3da54491-b854-4a5a-bf50-837a5c244488]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:15:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-130b438f-eaf6-4de2-aea9-c072f1dba85c tempest-VolumesListTestJSON-1626612204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-53321f3a-e900-4811-937c-3890185591bf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:14 devstack sudo[102488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-53321f3a-e900-4811-937c-3890185591bf Jul 09 10:15:14 devstack sudo[102488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:15 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5c8ac394-596a-4c17-bdeb-be6190b62db9 tempest-ProjectReaderTests-1938698804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.651s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-5c8ac394-596a-4c17-bdeb-be6190b62db9 tempest-ProjectReaderTests-1938698804 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:15:15 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5c8ac394-596a-4c17-bdeb-be6190b62db9 tempest-ProjectReaderTests-1938698804 None] Deleted volume successfully. Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5c8ac394-596a-4c17-bdeb-be6190b62db9 tempest-ProjectReaderTests-1938698804 None] Lock "cinder-3675370f-38ac-4ddb-b06f-d6c531fc0076-delete_volume" released by "delete_volume" :: held 2.393s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:15:15 devstack sudo[102488]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-130b438f-eaf6-4de2-aea9-c072f1dba85c tempest-VolumesListTestJSON-1626612204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-53321f3a-e900-4811-937c-3890185591bf" returned: 0 in 0.748s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-130b438f-eaf6-4de2-aea9-c072f1dba85c tempest-VolumesListTestJSON-1626612204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-53321f3a-e900-4811-937c-3890185591bf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:15 devstack sudo[102494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-53321f3a-e900-4811-937c-3890185591bf Jul 09 10:15:15 devstack sudo[102494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Flow 'volume_create_manager' (4936e730-74f4-4109-b73e-b5081554cd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671e5709-856a-46b6-b7b2-cecc44f2fe2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (671e5709-856a-46b6-b7b2-cecc44f2fe2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1501904240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c14f2e0b-7ba4-4226-875a-a8843d93a7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef163eddabb406ab514610c6fd7914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:15:16Z,use_quota=True,user_id='aff2dee11b704df5b66e6ca740bc9213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46686544-f0ef-402c-b4c9-adfb524b83f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46686544-f0ef-402c-b4c9-adfb524b83f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9029ae-aa9d-4351-9444-db9e5a23cf5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa9029ae-aa9d-4351-9444-db9e5a23cf5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c14f2e0b-7ba4-4226-875a-a8843d93a7a4', 'volume_name': 'volume-c14f2e0b-7ba4-4226-875a-a8843d93a7a4', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c617acdb-c86d-4835-b3d9-59b5f770898a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c617acdb-c86d-4835-b3d9-59b5f770898a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d3809c3-d03d-4bd8-9c7a-e437aa263b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:15 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Volume c14f2e0b-7ba4-4226-875a-a8843d93a7a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c14f2e0b-7ba4-4226-875a-a8843d93a7a4', 'volume_size': 1} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:15:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1501904240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c14f2e0b-7ba4-4226-875a-a8843d93a7a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aef163eddabb406ab514610c6fd7914c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:15:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:15:16Z,use_quota=True,user_id='aff2dee11b704df5b66e6ca740bc9213',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Creating volume c14f2e0b-7ba4-4226-875a-a8843d93a7a4 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:15:15 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:15:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c14f2e0b-7ba4-4226-875a-a8843d93a7a4 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:15 devstack sudo[102496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c14f2e0b-7ba4-4226-875a-a8843d93a7a4 1073741824 Jul 09 10:15:15 devstack sudo[102496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:16 devstack sudo[102494]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-130b438f-eaf6-4de2-aea9-c072f1dba85c tempest-VolumesListTestJSON-1626612204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-53321f3a-e900-4811-937c-3890185591bf" returned: 0 in 0.648s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-130b438f-eaf6-4de2-aea9-c072f1dba85c tempest-VolumesListTestJSON-1626612204 None] Lock "cinder-quobyte-53321f3a-e900-4811-937c-3890185591bf" released by "delete_volume" :: held 1.446s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:15:16 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-130b438f-eaf6-4de2-aea9-c072f1dba85c tempest-VolumesListTestJSON-1626612204 None] Created reservations ['c8b9b721-aee0-4be7-8bd7-7278910e063b', '7fb2ec2b-0b12-4538-895b-fe0fe7df43b3', 'ed640237-1e90-48f6-ab84-5f6f9b0d1858', '488fbf9c-c0fb-4674-bb76-d14280f99859'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:15:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-130b438f-eaf6-4de2-aea9-c072f1dba85c tempest-VolumesListTestJSON-1626612204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-130b438f-eaf6-4de2-aea9-c072f1dba85c tempest-VolumesListTestJSON-1626612204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-130b438f-eaf6-4de2-aea9-c072f1dba85c tempest-VolumesListTestJSON-1626612204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:15:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-130b438f-eaf6-4de2-aea9-c072f1dba85c tempest-VolumesListTestJSON-1626612204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:15:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-130b438f-eaf6-4de2-aea9-c072f1dba85c tempest-VolumesListTestJSON-1626612204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-130b438f-eaf6-4de2-aea9-c072f1dba85c tempest-VolumesListTestJSON-1626612204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:16 devstack sudo[102499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:15:16 devstack sudo[102499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:16 devstack sudo[102496]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c14f2e0b-7ba4-4226-875a-a8843d93a7a4 1073741824" returned: 0 in 0.811s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c14f2e0b-7ba4-4226-875a-a8843d93a7a4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:16 devstack sudo[102504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c14f2e0b-7ba4-4226-875a-a8843d93a7a4 Jul 09 10:15:16 devstack sudo[102504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3d0de5bd-0c04-4b2d-8c0e-aa84428b2e5a tempest-VolumesListTestJSON-1626612204 None] Acquiring lock "cinder-58f28b84-4cf9-4c9a-940e-7ed0278491d2-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:15:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3d0de5bd-0c04-4b2d-8c0e-aa84428b2e5a tempest-VolumesListTestJSON-1626612204 None] Lock "cinder-58f28b84-4cf9-4c9a-940e-7ed0278491d2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:15:17 devstack sudo[102499]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-130b438f-eaf6-4de2-aea9-c072f1dba85c tempest-VolumesListTestJSON-1626612204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.670s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:17 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-130b438f-eaf6-4de2-aea9-c072f1dba85c tempest-VolumesListTestJSON-1626612204 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:15:17 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-130b438f-eaf6-4de2-aea9-c072f1dba85c tempest-VolumesListTestJSON-1626612204 None] Deleted volume successfully. Jul 09 10:15:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3d0de5bd-0c04-4b2d-8c0e-aa84428b2e5a tempest-VolumesListTestJSON-1626612204 None] Acquiring lock "cinder-quobyte-58f28b84-4cf9-4c9a-940e-7ed0278491d2" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:15:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-130b438f-eaf6-4de2-aea9-c072f1dba85c tempest-VolumesListTestJSON-1626612204 None] Lock "cinder-53321f3a-e900-4811-937c-3890185591bf-delete_volume" released by "delete_volume" :: held 2.354s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:15:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3d0de5bd-0c04-4b2d-8c0e-aa84428b2e5a tempest-VolumesListTestJSON-1626612204 None] Lock "cinder-quobyte-58f28b84-4cf9-4c9a-940e-7ed0278491d2" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:15:17 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e79eb0-8537-4d69-b797-fb23f897a107]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:15:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3d0de5bd-0c04-4b2d-8c0e-aa84428b2e5a tempest-VolumesListTestJSON-1626612204 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-58f28b84-4cf9-4c9a-940e-7ed0278491d2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:17 devstack sudo[102507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-58f28b84-4cf9-4c9a-940e-7ed0278491d2 Jul 09 10:15:17 devstack sudo[102507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:17 devstack sudo[102504]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c14f2e0b-7ba4-4226-875a-a8843d93a7a4" returned: 0 in 0.665s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:17 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] <== create_volume: return (1520ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:15:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.523s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d3809c3-d03d-4bd8-9c7a-e437aa263b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c14f2e0b-7ba4-4226-875a-a8843d93a7a4', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b80c562-5126-4644-bd16-9c81d4841fdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:17 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Volume volume-c14f2e0b-7ba4-4226-875a-a8843d93a7a4 (c14f2e0b-7ba4-4226-875a-a8843d93a7a4): created successfully Jul 09 10:15:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b80c562-5126-4644-bd16-9c81d4841fdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:17 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Flow 'volume_create_manager' (4936e730-74f4-4109-b73e-b5081554cd6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:15:17 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-63f6163f-1065-438b-87ed-315ecc4b9ae5 tempest-ProjectReaderTests-1938698804 None] Created volume successfully. Jul 09 10:15:17 devstack sudo[102507]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3d0de5bd-0c04-4b2d-8c0e-aa84428b2e5a tempest-VolumesListTestJSON-1626612204 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-58f28b84-4cf9-4c9a-940e-7ed0278491d2" returned: 0 in 0.741s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3d0de5bd-0c04-4b2d-8c0e-aa84428b2e5a tempest-VolumesListTestJSON-1626612204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-58f28b84-4cf9-4c9a-940e-7ed0278491d2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:17 devstack sudo[102513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-58f28b84-4cf9-4c9a-940e-7ed0278491d2 Jul 09 10:15:17 devstack sudo[102513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-677c4402-f680-42e5-8f39-4e119da5a5e6 tempest-ProjectReaderTests-1938698804 None] Acquiring lock "cinder-c14f2e0b-7ba4-4226-875a-a8843d93a7a4-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:15:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-677c4402-f680-42e5-8f39-4e119da5a5e6 tempest-ProjectReaderTests-1938698804 None] Lock "cinder-c14f2e0b-7ba4-4226-875a-a8843d93a7a4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:15:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-677c4402-f680-42e5-8f39-4e119da5a5e6 tempest-ProjectReaderTests-1938698804 None] Acquiring lock "cinder-quobyte-c14f2e0b-7ba4-4226-875a-a8843d93a7a4" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:15:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-677c4402-f680-42e5-8f39-4e119da5a5e6 tempest-ProjectReaderTests-1938698804 None] Lock "cinder-quobyte-c14f2e0b-7ba4-4226-875a-a8843d93a7a4" acquired by "delete_volume" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:15:18 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[94aa0059-d18d-4f26-8eb7-1bb9ae208208]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:15:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-677c4402-f680-42e5-8f39-4e119da5a5e6 tempest-ProjectReaderTests-1938698804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c14f2e0b-7ba4-4226-875a-a8843d93a7a4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:18 devstack sudo[102516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c14f2e0b-7ba4-4226-875a-a8843d93a7a4 Jul 09 10:15:18 devstack sudo[102516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:18 devstack sudo[102513]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3d0de5bd-0c04-4b2d-8c0e-aa84428b2e5a tempest-VolumesListTestJSON-1626612204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-58f28b84-4cf9-4c9a-940e-7ed0278491d2" returned: 0 in 0.653s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3d0de5bd-0c04-4b2d-8c0e-aa84428b2e5a tempest-VolumesListTestJSON-1626612204 None] Lock "cinder-quobyte-58f28b84-4cf9-4c9a-940e-7ed0278491d2" released by "delete_volume" :: held 1.441s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:15:18 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-3d0de5bd-0c04-4b2d-8c0e-aa84428b2e5a tempest-VolumesListTestJSON-1626612204 None] Created reservations ['fcbd8995-cbe0-4a32-8f68-7786742d68a1', '9af4e3c8-f487-42f2-b35d-04e92210dbb1', '59e25667-1bfb-4c4a-8010-dc74ed13a9a2', '3520d10c-d62d-4313-afb0-106100112718'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:15:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3d0de5bd-0c04-4b2d-8c0e-aa84428b2e5a tempest-VolumesListTestJSON-1626612204 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3d0de5bd-0c04-4b2d-8c0e-aa84428b2e5a tempest-VolumesListTestJSON-1626612204 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3d0de5bd-0c04-4b2d-8c0e-aa84428b2e5a tempest-VolumesListTestJSON-1626612204 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:15:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3d0de5bd-0c04-4b2d-8c0e-aa84428b2e5a tempest-VolumesListTestJSON-1626612204 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:15:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3d0de5bd-0c04-4b2d-8c0e-aa84428b2e5a tempest-VolumesListTestJSON-1626612204 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3d0de5bd-0c04-4b2d-8c0e-aa84428b2e5a tempest-VolumesListTestJSON-1626612204 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:18 devstack sudo[102519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:15:18 devstack sudo[102519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:19 devstack sudo[102516]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-677c4402-f680-42e5-8f39-4e119da5a5e6 tempest-ProjectReaderTests-1938698804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c14f2e0b-7ba4-4226-875a-a8843d93a7a4" returned: 0 in 0.748s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-677c4402-f680-42e5-8f39-4e119da5a5e6 tempest-ProjectReaderTests-1938698804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c14f2e0b-7ba4-4226-875a-a8843d93a7a4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:19 devstack sudo[102524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c14f2e0b-7ba4-4226-875a-a8843d93a7a4 Jul 09 10:15:19 devstack sudo[102524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:19 devstack sudo[102519]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3d0de5bd-0c04-4b2d-8c0e-aa84428b2e5a tempest-VolumesListTestJSON-1626612204 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.659s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:19 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-3d0de5bd-0c04-4b2d-8c0e-aa84428b2e5a tempest-VolumesListTestJSON-1626612204 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:15:19 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3d0de5bd-0c04-4b2d-8c0e-aa84428b2e5a tempest-VolumesListTestJSON-1626612204 None] Deleted volume successfully. Jul 09 10:15:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3d0de5bd-0c04-4b2d-8c0e-aa84428b2e5a tempest-VolumesListTestJSON-1626612204 None] Lock "cinder-58f28b84-4cf9-4c9a-940e-7ed0278491d2-delete_volume" released by "delete_volume" :: held 2.343s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:15:19 devstack sudo[102524]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-677c4402-f680-42e5-8f39-4e119da5a5e6 tempest-ProjectReaderTests-1938698804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c14f2e0b-7ba4-4226-875a-a8843d93a7a4" returned: 0 in 0.713s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-677c4402-f680-42e5-8f39-4e119da5a5e6 tempest-ProjectReaderTests-1938698804 None] Lock "cinder-quobyte-c14f2e0b-7ba4-4226-875a-a8843d93a7a4" released by "delete_volume" :: held 1.500s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:15:19 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-677c4402-f680-42e5-8f39-4e119da5a5e6 tempest-ProjectReaderTests-1938698804 None] Created reservations ['1e59008a-dc8a-45e1-8cb0-26c877bb8912', '9ab43f67-651e-4ef7-b894-dfcf78c63ce6', 'cfba4fe5-9f45-40ae-bce3-67c541a7eb34', '9e305f08-96ed-4528-9122-5db3af7719dd'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:15:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-677c4402-f680-42e5-8f39-4e119da5a5e6 tempest-ProjectReaderTests-1938698804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-677c4402-f680-42e5-8f39-4e119da5a5e6 tempest-ProjectReaderTests-1938698804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-677c4402-f680-42e5-8f39-4e119da5a5e6 tempest-ProjectReaderTests-1938698804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:15:19 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-677c4402-f680-42e5-8f39-4e119da5a5e6 tempest-ProjectReaderTests-1938698804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:15:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-677c4402-f680-42e5-8f39-4e119da5a5e6 tempest-ProjectReaderTests-1938698804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-677c4402-f680-42e5-8f39-4e119da5a5e6 tempest-ProjectReaderTests-1938698804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:20 devstack sudo[102528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:15:20 devstack sudo[102528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:20 devstack sudo[102528]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-677c4402-f680-42e5-8f39-4e119da5a5e6 tempest-ProjectReaderTests-1938698804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.686s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:20 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-677c4402-f680-42e5-8f39-4e119da5a5e6 tempest-ProjectReaderTests-1938698804 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:15:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-677c4402-f680-42e5-8f39-4e119da5a5e6 tempest-ProjectReaderTests-1938698804 None] Deleted volume successfully. Jul 09 10:15:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-677c4402-f680-42e5-8f39-4e119da5a5e6 tempest-ProjectReaderTests-1938698804 None] Lock "cinder-c14f2e0b-7ba4-4226-875a-a8843d93a7a4-delete_volume" released by "delete_volume" :: held 2.403s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Flow 'volume_create_manager' (8eaa5fa6-7aed-40ac-856a-3ba4423d058b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98c28bc-5e75-4689-a755-f8152cb0fb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e98c28bc-5e75-4689-a755-f8152cb0fb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-354595460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=855f2af4-2295-4bff-9a40-b0c02c68808c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8ca3128862416ca327c9181b0445ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:15:22Z,use_quota=True,user_id='8d07f5f00e6f403c87fd2d5d564d103e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f3c1b1-37c3-404b-8ed7-30d23709fc84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e2f3c1b1-37c3-404b-8ed7-30d23709fc84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6062cc-98d0-40dd-9f50-ed137fc88530) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a6062cc-98d0-40dd-9f50-ed137fc88530) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '855f2af4-2295-4bff-9a40-b0c02c68808c', 'volume_name': 'volume-855f2af4-2295-4bff-9a40-b0c02c68808c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4dfb5bf-3310-4f01-8b8a-74cf08d8d654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4dfb5bf-3310-4f01-8b8a-74cf08d8d654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321ab0c1-1bbb-4a9e-b9ca-ba9d046ab47c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:22 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Volume 855f2af4-2295-4bff-9a40-b0c02c68808c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-855f2af4-2295-4bff-9a40-b0c02c68808c', 'volume_size': 1} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:15:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-354595460',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=855f2af4-2295-4bff-9a40-b0c02c68808c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa8ca3128862416ca327c9181b0445ef',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:15:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:15:22Z,use_quota=True,user_id='8d07f5f00e6f403c87fd2d5d564d103e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Creating volume 855f2af4-2295-4bff-9a40-b0c02c68808c {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:15:22 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:15:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-855f2af4-2295-4bff-9a40-b0c02c68808c 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:22 devstack sudo[102531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-855f2af4-2295-4bff-9a40-b0c02c68808c 1073741824 Jul 09 10:15:22 devstack sudo[102531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:23 devstack sudo[102531]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-855f2af4-2295-4bff-9a40-b0c02c68808c 1073741824" returned: 0 in 0.794s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-855f2af4-2295-4bff-9a40-b0c02c68808c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:23 devstack sudo[102536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-855f2af4-2295-4bff-9a40-b0c02c68808c Jul 09 10:15:23 devstack sudo[102536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:23 devstack sudo[102536]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-855f2af4-2295-4bff-9a40-b0c02c68808c" returned: 0 in 0.629s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] <== create_volume: return (1466ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:15:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.468s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (321ab0c1-1bbb-4a9e-b9ca-ba9d046ab47c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-855f2af4-2295-4bff-9a40-b0c02c68808c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb1adfa-2e6a-4eaf-8d17-256057f7c661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:15:23 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Volume volume-855f2af4-2295-4bff-9a40-b0c02c68808c (855f2af4-2295-4bff-9a40-b0c02c68808c): created successfully Jul 09 10:15:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4eb1adfa-2e6a-4eaf-8d17-256057f7c661) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:15:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Flow 'volume_create_manager' (8eaa5fa6-7aed-40ac-856a-3ba4423d058b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:15:23 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a90134f2-61dd-4375-8c4e-c5ebbc6f4d2f tempest-VolumesNegativeTest-1480805766 None] Created volume successfully. Jul 09 10:15:29 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=119,cinder:SELECT=75,cinder:INSERT=27,cinder:DELETE=11 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:15:29 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=76,cinder:UPDATE=106,cinder:DELETE=8,cinder:INSERT=25 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:15:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:15:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:15:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:15:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:29 devstack sudo[102543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:15:29 devstack sudo[102543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:30 devstack sudo[102543]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.678s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:15:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:15:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:15:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:15:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-aa7c548c-3077-4c21-b496-c593d56a855a tempest-VolumesNegativeTest-1480805766 None] Acquiring lock "cinder-855f2af4-2295-4bff-9a40-b0c02c68808c-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:15:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-aa7c548c-3077-4c21-b496-c593d56a855a tempest-VolumesNegativeTest-1480805766 None] Lock "cinder-855f2af4-2295-4bff-9a40-b0c02c68808c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:15:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-aa7c548c-3077-4c21-b496-c593d56a855a tempest-VolumesNegativeTest-1480805766 None] Acquiring lock "cinder-quobyte-855f2af4-2295-4bff-9a40-b0c02c68808c" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:15:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-aa7c548c-3077-4c21-b496-c593d56a855a tempest-VolumesNegativeTest-1480805766 None] Lock "cinder-quobyte-855f2af4-2295-4bff-9a40-b0c02c68808c" acquired by "delete_volume" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:15:52 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[20356133-edd8-41eb-9c9c-ccdff70fcd5c]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:15:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aa7c548c-3077-4c21-b496-c593d56a855a tempest-VolumesNegativeTest-1480805766 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-855f2af4-2295-4bff-9a40-b0c02c68808c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:52 devstack sudo[102711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-855f2af4-2295-4bff-9a40-b0c02c68808c Jul 09 10:15:52 devstack sudo[102711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:52 devstack sudo[102711]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aa7c548c-3077-4c21-b496-c593d56a855a tempest-VolumesNegativeTest-1480805766 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-855f2af4-2295-4bff-9a40-b0c02c68808c" returned: 0 in 0.722s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aa7c548c-3077-4c21-b496-c593d56a855a tempest-VolumesNegativeTest-1480805766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-855f2af4-2295-4bff-9a40-b0c02c68808c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:52 devstack sudo[102716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-855f2af4-2295-4bff-9a40-b0c02c68808c Jul 09 10:15:52 devstack sudo[102716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:53 devstack sudo[102716]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aa7c548c-3077-4c21-b496-c593d56a855a tempest-VolumesNegativeTest-1480805766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-855f2af4-2295-4bff-9a40-b0c02c68808c" returned: 0 in 0.618s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-aa7c548c-3077-4c21-b496-c593d56a855a tempest-VolumesNegativeTest-1480805766 None] Lock "cinder-quobyte-855f2af4-2295-4bff-9a40-b0c02c68808c" released by "delete_volume" :: held 1.375s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:15:53 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-aa7c548c-3077-4c21-b496-c593d56a855a tempest-VolumesNegativeTest-1480805766 None] Created reservations ['2384d1fa-9373-4a25-8b83-7f8af903e4e5', 'a55c077f-6c9c-4ef4-82a0-67f6d84f391d', '253af109-8909-469a-a186-cd861b2e85f6', '9ec973f6-1196-4a90-bf73-f52fe3f36fe4'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:15:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aa7c548c-3077-4c21-b496-c593d56a855a tempest-VolumesNegativeTest-1480805766 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:15:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aa7c548c-3077-4c21-b496-c593d56a855a tempest-VolumesNegativeTest-1480805766 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:15:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aa7c548c-3077-4c21-b496-c593d56a855a tempest-VolumesNegativeTest-1480805766 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:15:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-aa7c548c-3077-4c21-b496-c593d56a855a tempest-VolumesNegativeTest-1480805766 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:15:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-aa7c548c-3077-4c21-b496-c593d56a855a tempest-VolumesNegativeTest-1480805766 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:15:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aa7c548c-3077-4c21-b496-c593d56a855a tempest-VolumesNegativeTest-1480805766 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:15:53 devstack sudo[102719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:15:53 devstack sudo[102719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:15:54 devstack sudo[102719]: pam_unix(sudo:session): session closed for user root Jul 09 10:15:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-aa7c548c-3077-4c21-b496-c593d56a855a tempest-VolumesNegativeTest-1480805766 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.635s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:15:54 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-aa7c548c-3077-4c21-b496-c593d56a855a tempest-VolumesNegativeTest-1480805766 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:15:54 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-aa7c548c-3077-4c21-b496-c593d56a855a tempest-VolumesNegativeTest-1480805766 None] Deleted volume successfully. Jul 09 10:15:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-aa7c548c-3077-4c21-b496-c593d56a855a tempest-VolumesNegativeTest-1480805766 None] Lock "cinder-855f2af4-2295-4bff-9a40-b0c02c68808c-delete_volume" released by "delete_volume" :: held 2.201s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:16:03 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:16:04 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=7,cinder:SELECT=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Flow 'volume_create_manager' (98d30163-3af2-4ae5-bf39-bffa1d598ab6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70ac1a4-d7cb-4133-aba0-c9acce9b335f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f70ac1a4-d7cb-4133-aba0-c9acce9b335f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1606567129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8930cd3-5520-4244-ba0a-51efa5bdc648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7db3777df7a4a8da752e4b7d4bbd438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:16:29Z,use_quota=True,user_id='c6d880214295424eb44635c279b14569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ced8c4-7655-4d60-ae7b-039f1984790c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0ced8c4-7655-4d60-ae7b-039f1984790c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c36b247-e6d8-4166-b280-adb06e57c89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c36b247-e6d8-4166-b280-adb06e57c89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a8930cd3-5520-4244-ba0a-51efa5bdc648', 'volume_name': 'volume-a8930cd3-5520-4244-ba0a-51efa5bdc648', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427d4f7a-bfa0-4fdd-9c27-bb1358229f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427d4f7a-bfa0-4fdd-9c27-bb1358229f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43945fcf-e4c7-47af-915c-47ef19c6a8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:16:29 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Volume a8930cd3-5520-4244-ba0a-51efa5bdc648: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a8930cd3-5520-4244-ba0a-51efa5bdc648', 'volume_size': 1} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:16:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1606567129',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a8930cd3-5520-4244-ba0a-51efa5bdc648,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7db3777df7a4a8da752e4b7d4bbd438',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:16:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:16:29Z,use_quota=True,user_id='c6d880214295424eb44635c279b14569',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Creating volume a8930cd3-5520-4244-ba0a-51efa5bdc648 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:16:29 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a8930cd3-5520-4244-ba0a-51efa5bdc648 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:16:29 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a8930cd3-5520-4244-ba0a-51efa5bdc648 1073741824 Jul 09 10:16:29 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:16:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:16:29 devstack sudo[102841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:16:29 devstack sudo[102841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:16:30 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Jul 09 10:16:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a8930cd3-5520-4244-ba0a-51efa5bdc648 1073741824" returned: 0 in 0.862s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:16:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a8930cd3-5520-4244-ba0a-51efa5bdc648 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:16:30 devstack sudo[102847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a8930cd3-5520-4244-ba0a-51efa5bdc648 Jul 09 10:16:30 devstack sudo[102847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:16:30 devstack sudo[102841]: pam_unix(sudo:session): session closed for user root Jul 09 10:16:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.704s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:16:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:16:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:16:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:16:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:16:31 devstack sudo[102847]: pam_unix(sudo:session): session closed for user root Jul 09 10:16:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a8930cd3-5520-4244-ba0a-51efa5bdc648" returned: 0 in 0.653s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:16:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:16:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.567s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:16:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43945fcf-e4c7-47af-915c-47ef19c6a8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a8930cd3-5520-4244-ba0a-51efa5bdc648', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:16:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41cba91d-d916-4a79-8286-83906b9bc0c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:16:31 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Volume volume-a8930cd3-5520-4244-ba0a-51efa5bdc648 (a8930cd3-5520-4244-ba0a-51efa5bdc648): created successfully Jul 09 10:16:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (41cba91d-d916-4a79-8286-83906b9bc0c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:16:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Flow 'volume_create_manager' (98d30163-3af2-4ae5-bf39-bffa1d598ab6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:16:31 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c9bf378b-4a2b-4f0c-936f-50f2ba4a747c tempest-TestMinimumBasicScenario-1111400941 None] Created volume successfully. Jul 09 10:16:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-1880bd26-bbad-4b5f-a7f0-6d5919540a9e req-d6f6fc7b-5682-4f98-90bd-403707f18604 tempest-TestMinimumBasicScenario-1111400941 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:16:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-1880bd26-bbad-4b5f-a7f0-6d5919540a9e req-d6f6fc7b-5682-4f98-90bd-403707f18604 tempest-TestMinimumBasicScenario-1111400941 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:16:34 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6adcab1d-112b-4fa3-be3d-e46eed822203]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:16:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-1880bd26-bbad-4b5f-a7f0-6d5919540a9e req-d6f6fc7b-5682-4f98-90bd-403707f18604 tempest-TestMinimumBasicScenario-1111400941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a8930cd3-5520-4244-ba0a-51efa5bdc648 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:16:35 devstack sudo[102897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a8930cd3-5520-4244-ba0a-51efa5bdc648 Jul 09 10:16:35 devstack sudo[102897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:16:35 devstack sudo[102897]: pam_unix(sudo:session): session closed for user root Jul 09 10:16:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-1880bd26-bbad-4b5f-a7f0-6d5919540a9e req-d6f6fc7b-5682-4f98-90bd-403707f18604 tempest-TestMinimumBasicScenario-1111400941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a8930cd3-5520-4244-ba0a-51efa5bdc648" returned: 0 in 0.751s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:16:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-1880bd26-bbad-4b5f-a7f0-6d5919540a9e req-d6f6fc7b-5682-4f98-90bd-403707f18604 tempest-TestMinimumBasicScenario-1111400941 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.769s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:16:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-1880bd26-bbad-4b5f-a7f0-6d5919540a9e req-d6f6fc7b-5682-4f98-90bd-403707f18604 tempest-TestMinimumBasicScenario-1111400941 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-a8930cd3-5520-4244-ba0a-51efa5bdc648', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '8886d42f-0b17-455c-98a2-13177f12883f', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:16:35 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-1880bd26-bbad-4b5f-a7f0-6d5919540a9e req-d6f6fc7b-5682-4f98-90bd-403707f18604 tempest-TestMinimumBasicScenario-1111400941 None] attachment_update completed successfully. Jul 09 10:16:45 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=4,cinder:SELECT=6,cinder:INSERT=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:16:45 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=9,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:17:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-9286ff45-4e78-47c3-bb41-890f4b50090d req-a3e61678-0689-4a7d-b1b9-ea57f758e8dc tempest-TestMinimumBasicScenario-1111400941 None] Terminate volume connection completed successfully. Jul 09 10:17:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-9286ff45-4e78-47c3-bb41-890f4b50090d req-a3e61678-0689-4a7d-b1b9-ea57f758e8dc tempest-TestMinimumBasicScenario-1111400941 None] Deleting attachment 8886d42f-0b17-455c-98a2-13177f12883f. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:17:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-340dddc1-b73f-4827-825c-35ddc7b0ebbe tempest-TestMinimumBasicScenario-1111400941 None] Acquiring lock "cinder-a8930cd3-5520-4244-ba0a-51efa5bdc648-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:17:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-340dddc1-b73f-4827-825c-35ddc7b0ebbe tempest-TestMinimumBasicScenario-1111400941 None] Lock "cinder-a8930cd3-5520-4244-ba0a-51efa5bdc648-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:17:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-340dddc1-b73f-4827-825c-35ddc7b0ebbe tempest-TestMinimumBasicScenario-1111400941 None] Acquiring lock "cinder-quobyte-a8930cd3-5520-4244-ba0a-51efa5bdc648" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:17:22 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-340dddc1-b73f-4827-825c-35ddc7b0ebbe tempest-TestMinimumBasicScenario-1111400941 None] Lock "cinder-quobyte-a8930cd3-5520-4244-ba0a-51efa5bdc648" acquired by "delete_volume" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:17:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a7afdc9-2a54-44bc-81ee-f7b05dd79199]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:17:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-340dddc1-b73f-4827-825c-35ddc7b0ebbe tempest-TestMinimumBasicScenario-1111400941 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a8930cd3-5520-4244-ba0a-51efa5bdc648 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:17:22 devstack sudo[103406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a8930cd3-5520-4244-ba0a-51efa5bdc648 Jul 09 10:17:22 devstack sudo[103406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:17:23 devstack sudo[103406]: pam_unix(sudo:session): session closed for user root Jul 09 10:17:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-340dddc1-b73f-4827-825c-35ddc7b0ebbe tempest-TestMinimumBasicScenario-1111400941 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a8930cd3-5520-4244-ba0a-51efa5bdc648" returned: 0 in 0.731s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:17:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-340dddc1-b73f-4827-825c-35ddc7b0ebbe tempest-TestMinimumBasicScenario-1111400941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a8930cd3-5520-4244-ba0a-51efa5bdc648 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:17:23 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a8930cd3-5520-4244-ba0a-51efa5bdc648 Jul 09 10:17:23 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:17:23 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Jul 09 10:17:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-340dddc1-b73f-4827-825c-35ddc7b0ebbe tempest-TestMinimumBasicScenario-1111400941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a8930cd3-5520-4244-ba0a-51efa5bdc648" returned: 0 in 0.639s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:17:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-340dddc1-b73f-4827-825c-35ddc7b0ebbe tempest-TestMinimumBasicScenario-1111400941 None] Lock "cinder-quobyte-a8930cd3-5520-4244-ba0a-51efa5bdc648" released by "delete_volume" :: held 1.415s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:17:23 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-340dddc1-b73f-4827-825c-35ddc7b0ebbe tempest-TestMinimumBasicScenario-1111400941 None] Created reservations ['cdb538b3-da48-4786-9fab-9552d1887ccb', '6a4af761-485f-4141-8102-40a3673d6603', 'a57e43f4-8d9b-4d35-8ab5-5a76cce00c1e', 'b8b784e7-7530-4b25-a03c-341327ed0af1'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:17:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-340dddc1-b73f-4827-825c-35ddc7b0ebbe tempest-TestMinimumBasicScenario-1111400941 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:17:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-340dddc1-b73f-4827-825c-35ddc7b0ebbe tempest-TestMinimumBasicScenario-1111400941 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:17:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-340dddc1-b73f-4827-825c-35ddc7b0ebbe tempest-TestMinimumBasicScenario-1111400941 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:17:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-340dddc1-b73f-4827-825c-35ddc7b0ebbe tempest-TestMinimumBasicScenario-1111400941 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:17:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-340dddc1-b73f-4827-825c-35ddc7b0ebbe tempest-TestMinimumBasicScenario-1111400941 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:17:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-340dddc1-b73f-4827-825c-35ddc7b0ebbe tempest-TestMinimumBasicScenario-1111400941 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:17:24 devstack sudo[103415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:17:24 devstack sudo[103415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:17:24 devstack sudo[103415]: pam_unix(sudo:session): session closed for user root Jul 09 10:17:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-340dddc1-b73f-4827-825c-35ddc7b0ebbe tempest-TestMinimumBasicScenario-1111400941 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.683s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:17:24 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-340dddc1-b73f-4827-825c-35ddc7b0ebbe tempest-TestMinimumBasicScenario-1111400941 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:17:24 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-340dddc1-b73f-4827-825c-35ddc7b0ebbe tempest-TestMinimumBasicScenario-1111400941 None] Deleted volume successfully. Jul 09 10:17:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-340dddc1-b73f-4827-825c-35ddc7b0ebbe tempest-TestMinimumBasicScenario-1111400941 None] Lock "cinder-a8930cd3-5520-4244-ba0a-51efa5bdc648-delete_volume" released by "delete_volume" :: held 2.317s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:17:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:17:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:17:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:17:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:17:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:17:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:17:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:17:29 devstack sudo[103442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:17:29 devstack sudo[103442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:17:30 devstack sudo[103442]: pam_unix(sudo:session): session closed for user root Jul 09 10:17:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.653s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:17:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:17:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:17:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:17:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:17:39 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=7,cinder:UPDATE=8,cinder:INSERT=2 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:17:39 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:18:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:18:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:18:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:18:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:18:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:18:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:18:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:18:29 devstack sudo[103611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:18:29 devstack sudo[103611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:18:30 devstack sudo[103611]: pam_unix(sudo:session): session closed for user root Jul 09 10:18:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.658s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:18:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:18:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:18:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:18:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Flow 'volume_create_manager' (d886faa5-2946-4724-bb9d-1c76cd8cd552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372c8094-af19-49b7-89a6-286a9f2e5645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (372c8094-af19-49b7-89a6-286a9f2e5645) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1239067573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d3b895-9f1c-46f2-9969-fdef83656f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2851766651634fc4be6d5834bd5cabbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:18:36Z,use_quota=True,user_id='8e503056e52147c3bfa81e19c7115589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f23348f-7202-4a75-bf92-ca8a0740ce09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f23348f-7202-4a75-bf92-ca8a0740ce09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4866f29b-fb12-445d-be2e-ecbb21eba5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4866f29b-fb12-445d-be2e-ecbb21eba5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '17d3b895-9f1c-46f2-9969-fdef83656f13', 'volume_name': 'volume-17d3b895-9f1c-46f2-9969-fdef83656f13', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13371629-3a53-4532-8e6a-ad71acf4b9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13371629-3a53-4532-8e6a-ad71acf4b9a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b00f152-aaca-4850-b67e-79fbc484e565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:18:36 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Volume 17d3b895-9f1c-46f2-9969-fdef83656f13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-17d3b895-9f1c-46f2-9969-fdef83656f13', 'volume_size': 1} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:18:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1239067573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=17d3b895-9f1c-46f2-9969-fdef83656f13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2851766651634fc4be6d5834bd5cabbd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:18:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:18:36Z,use_quota=True,user_id='8e503056e52147c3bfa81e19c7115589',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Creating volume 17d3b895-9f1c-46f2-9969-fdef83656f13 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:18:36 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:18:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-17d3b895-9f1c-46f2-9969-fdef83656f13 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:18:36 devstack sudo[103652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-17d3b895-9f1c-46f2-9969-fdef83656f13 1073741824 Jul 09 10:18:36 devstack sudo[103652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:18:37 devstack sudo[103652]: pam_unix(sudo:session): session closed for user root Jul 09 10:18:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-17d3b895-9f1c-46f2-9969-fdef83656f13 1073741824" returned: 0 in 0.829s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:18:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-17d3b895-9f1c-46f2-9969-fdef83656f13 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:18:37 devstack sudo[103657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-17d3b895-9f1c-46f2-9969-fdef83656f13 Jul 09 10:18:37 devstack sudo[103657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:18:37 devstack sudo[103657]: pam_unix(sudo:session): session closed for user root Jul 09 10:18:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-17d3b895-9f1c-46f2-9969-fdef83656f13" returned: 0 in 0.623s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:18:37 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] <== create_volume: return (1494ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:18:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.497s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:18:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3b00f152-aaca-4850-b67e-79fbc484e565) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-17d3b895-9f1c-46f2-9969-fdef83656f13', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:18:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a012e39-a9db-4282-ae56-70083453efe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:18:37 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Volume volume-17d3b895-9f1c-46f2-9969-fdef83656f13 (17d3b895-9f1c-46f2-9969-fdef83656f13): created successfully Jul 09 10:18:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a012e39-a9db-4282-ae56-70083453efe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:18:37 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Flow 'volume_create_manager' (d886faa5-2946-4724-bb9d-1c76cd8cd552) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:18:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a7f0a056-a8f0-4626-a0ee-df559ccc0054 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Created volume successfully. Jul 09 10:18:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-bf7cedab-8916-4ebb-a18d-038a519d3a8c req-c8cb6185-ec4a-4106-a9b2-308ccef35534 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:18:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-bf7cedab-8916-4ebb-a18d-038a519d3a8c req-c8cb6185-ec4a-4106-a9b2-308ccef35534 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:18:41 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad86335-1242-46b9-8fd9-b4ca3b611fa1]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:18:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-bf7cedab-8916-4ebb-a18d-038a519d3a8c req-c8cb6185-ec4a-4106-a9b2-308ccef35534 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-17d3b895-9f1c-46f2-9969-fdef83656f13 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:18:41 devstack sudo[103672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-17d3b895-9f1c-46f2-9969-fdef83656f13 Jul 09 10:18:41 devstack sudo[103672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:18:42 devstack sudo[103672]: pam_unix(sudo:session): session closed for user root Jul 09 10:18:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-bf7cedab-8916-4ebb-a18d-038a519d3a8c req-c8cb6185-ec4a-4106-a9b2-308ccef35534 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-17d3b895-9f1c-46f2-9969-fdef83656f13" returned: 0 in 0.791s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:18:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-bf7cedab-8916-4ebb-a18d-038a519d3a8c req-c8cb6185-ec4a-4106-a9b2-308ccef35534 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.808s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:18:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-bf7cedab-8916-4ebb-a18d-038a519d3a8c req-c8cb6185-ec4a-4106-a9b2-308ccef35534 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-17d3b895-9f1c-46f2-9969-fdef83656f13', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2b7d91eb-6da0-4a17-a4ab-3cbcc83d38f2', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:18:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-bf7cedab-8916-4ebb-a18d-038a519d3a8c req-c8cb6185-ec4a-4106-a9b2-308ccef35534 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] attachment_update completed successfully. Jul 09 10:18:48 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-e712d4cb-f2c6-496b-af00-39a655477ee9 req-9db29ee1-e541-4b94-84dd-c731830a54d6 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Terminate volume connection completed successfully. Jul 09 10:18:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-e712d4cb-f2c6-496b-af00-39a655477ee9 req-9db29ee1-e541-4b94-84dd-c731830a54d6 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Deleting attachment 2b7d91eb-6da0-4a17-a4ab-3cbcc83d38f2. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:18:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-06177c15-028c-4d93-9382-a216372202e4 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Acquiring lock "cinder-17d3b895-9f1c-46f2-9969-fdef83656f13-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:18:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-06177c15-028c-4d93-9382-a216372202e4 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Lock "cinder-17d3b895-9f1c-46f2-9969-fdef83656f13-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:18:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-06177c15-028c-4d93-9382-a216372202e4 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Acquiring lock "cinder-quobyte-17d3b895-9f1c-46f2-9969-fdef83656f13" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:18:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-06177c15-028c-4d93-9382-a216372202e4 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Lock "cinder-quobyte-17d3b895-9f1c-46f2-9969-fdef83656f13" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:18:50 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc36c77-d14b-4994-a13c-91ad1222246e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:18:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06177c15-028c-4d93-9382-a216372202e4 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-17d3b895-9f1c-46f2-9969-fdef83656f13 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:18:50 devstack sudo[104102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-17d3b895-9f1c-46f2-9969-fdef83656f13 Jul 09 10:18:50 devstack sudo[104102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:18:51 devstack sudo[104102]: pam_unix(sudo:session): session closed for user root Jul 09 10:18:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06177c15-028c-4d93-9382-a216372202e4 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-17d3b895-9f1c-46f2-9969-fdef83656f13" returned: 0 in 0.743s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:18:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06177c15-028c-4d93-9382-a216372202e4 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-17d3b895-9f1c-46f2-9969-fdef83656f13 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:18:51 devstack sudo[104107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-17d3b895-9f1c-46f2-9969-fdef83656f13 Jul 09 10:18:51 devstack sudo[104107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:18:51 devstack sudo[104107]: pam_unix(sudo:session): session closed for user root Jul 09 10:18:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06177c15-028c-4d93-9382-a216372202e4 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-17d3b895-9f1c-46f2-9969-fdef83656f13" returned: 0 in 0.667s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:18:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-06177c15-028c-4d93-9382-a216372202e4 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Lock "cinder-quobyte-17d3b895-9f1c-46f2-9969-fdef83656f13" released by "delete_volume" :: held 1.448s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:18:51 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-06177c15-028c-4d93-9382-a216372202e4 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Created reservations ['3435ceba-1a71-41c3-8d21-ce8349b0a8db', 'a5686f76-e35e-4863-9998-d884dc3fd8f7', '09630009-be19-4f2c-b025-3268737709fd', '658c13e9-06d8-4744-8858-89097c33d0ea'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:18:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06177c15-028c-4d93-9382-a216372202e4 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:18:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06177c15-028c-4d93-9382-a216372202e4 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:18:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06177c15-028c-4d93-9382-a216372202e4 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:18:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-06177c15-028c-4d93-9382-a216372202e4 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:18:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-06177c15-028c-4d93-9382-a216372202e4 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:18:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06177c15-028c-4d93-9382-a216372202e4 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:18:51 devstack sudo[104110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:18:51 devstack sudo[104110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:18:52 devstack sudo[104110]: pam_unix(sudo:session): session closed for user root Jul 09 10:18:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-06177c15-028c-4d93-9382-a216372202e4 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.634s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:18:52 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-06177c15-028c-4d93-9382-a216372202e4 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:18:52 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-06177c15-028c-4d93-9382-a216372202e4 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Deleted volume successfully. Jul 09 10:18:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-06177c15-028c-4d93-9382-a216372202e4 tempest-TestServerVolumeAttachScenarioOldVersion-164209391 None] Lock "cinder-17d3b895-9f1c-46f2-9969-fdef83656f13-delete_volume" released by "delete_volume" :: held 2.288s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:19:01 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=10,cinder:UPDATE=13,cinder:INSERT=3,cinder:DELETE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:19:02 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=17,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:19:28 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:19:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Flow 'volume_create_manager' (8f41491b-646e-4a43-bbfd-ea0dcf7084cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:19:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f38838-9e2f-4516-a3b8-9be488707916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:19:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27f38838-9e2f-4516-a3b8-9be488707916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1272231594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b179537-55d1-4dab-ab23-70008570b8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bacf38539b9b4803940ed31f9a9d35b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:19:28Z,use_quota=True,user_id='03eee91ce91643f0b85812b76e6a1970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:19:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e3f09f-9c7e-429d-9684-5fc2cede0ff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:19:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (28e3f09f-9c7e-429d-9684-5fc2cede0ff4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:19:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57140472-68b2-45b3-8370-4b3907343f95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:19:28 devstack cinder-volume[87192]: DEBUG cinder.image.glance [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Creating Keystone auth plugin from conf {{(pid=87192) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 10:19:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57140472-68b2-45b3-8370-4b3907343f95) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0b179537-55d1-4dab-ab23-70008570b8d8', 'volume_name': 'volume-0b179537-55d1-4dab-ab23-70008570b8d8', 'volume_size': 1, 'image_id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fbd1c6e24b394cf998d7f93c3a7d72f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'created_at': datetime.datetime(2026, 7, 9, 7, 52, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 52, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:19:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabd8586-263d-4baf-b09e-328e3d5be61b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:19:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eabd8586-263d-4baf-b09e-328e3d5be61b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:19:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d5f9b0a-20db-48d2-a2bc-20069482d694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:19:28 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Volume 0b179537-55d1-4dab-ab23-70008570b8d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0b179537-55d1-4dab-ab23-70008570b8d8', 'volume_size': 1, 'image_id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fbd1c6e24b394cf998d7f93c3a7d72f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'created_at': datetime.datetime(2026, 7, 9, 7, 52, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 52, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 09 10:19:28 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Trying to clone 0b179537-55d1-4dab-ab23-70008570b8d8 from image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}]). {{(pid=87192) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 10:19:29 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0ppaj4ordevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 10:19:29 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Image download 20.69 MB at 20.69 MB/s Jul 09 10:19:29 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a956ce3-032d-4127-86e7-6a75517bdceb]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:19:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0ppaj4ordevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:19:29 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0ppaj4ordevstack@QuobyteHD Jul 09 10:19:29 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:19:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:19:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:19:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:19:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:19:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:19:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:19:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:19:29 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:19:29 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:19:29 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Jul 09 10:19:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0ppaj4ordevstack@QuobyteHD" returned: 0 in 0.705s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:19:29 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Temporary image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 is fetched for user 03eee91ce91643f0b85812b76e6a1970. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 10:19:29 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c5a0a1-7373-4b8d-b7af-f90009f3ba2e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:19:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0ppaj4ordevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:19:30 devstack sudo[104158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0ppaj4ordevstack@QuobyteHD Jul 09 10:19:30 devstack sudo[104158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:19:30 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Jul 09 10:19:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.684s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:19:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:19:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:19:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:19:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:19:30 devstack sudo[104158]: pam_unix(sudo:session): session closed for user root Jul 09 10:19:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0ppaj4ordevstack@QuobyteHD" returned: 0 in 0.735s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:19:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:19:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:19:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:19:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1272231594',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b179537-55d1-4dab-ab23-70008570b8d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bacf38539b9b4803940ed31f9a9d35b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:19:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:19:28Z,use_quota=True,user_id='03eee91ce91643f0b85812b76e6a1970',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:19:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Creating volume 0b179537-55d1-4dab-ab23-70008570b8d8 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:19:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:19:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:19:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:19:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:19:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:19:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:19:30 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:19:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:19:30 devstack sudo[104164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 1073741824 Jul 09 10:19:30 devstack sudo[104164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:19:31 devstack sudo[104164]: pam_unix(sudo:session): session closed for user root Jul 09 10:19:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 1073741824" returned: 0 in 0.812s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:19:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:19:31 devstack sudo[104169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 Jul 09 10:19:31 devstack sudo[104169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:19:32 devstack sudo[104169]: pam_unix(sudo:session): session closed for user root Jul 09 10:19:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8" returned: 0 in 0.615s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:19:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:19:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.467s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:19:32 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Attempting download of fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}])) to volume 0b179537-55d1-4dab-ab23-70008570b8d8. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 10:19:32 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[929f8717-6b4d-4bde-a4a1-1fada1fcc96e]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:19:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_foo2wf3c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:19:32 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_foo2wf3c Jul 09 10:19:32 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:19:32 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Jul 09 10:19:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_foo2wf3c" returned: 0 in 0.712s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:19:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_foo2wf3c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:19:33 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_foo2wf3c Jul 09 10:19:33 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:19:33 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Jul 09 10:19:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_foo2wf3c" returned: 1 in 0.708s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:19:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_foo2wf3c' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:19:33 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e607494-9d73-448a-a364-8d44f90c5e27]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:19:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0ppaj4ordevstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:19:33 devstack sudo[104180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0ppaj4ordevstack@QuobyteHD Jul 09 10:19:33 devstack sudo[104180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:19:34 devstack sudo[104180]: pam_unix(sudo:session): session closed for user root Jul 09 10:19:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0ppaj4ordevstack@QuobyteHD" returned: 0 in 0.736s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:19:34 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 was qcow2, converting to raw {{(pid=87192) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 10:19:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0ppaj4ordevstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:19:34 devstack sudo[104199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0ppaj4ordevstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 Jul 09 10:19:34 devstack sudo[104199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:19:36 devstack sudo[104199]: pam_unix(sudo:session): session closed for user root Jul 09 10:19:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0ppaj4ordevstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8" returned: 0 in 1.729s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:19:36 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1_0ppaj4ordevstack@QuobyteHD, size 112.00 MB, duration 1.73 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:19:36 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Converted 112.00 MB image at 64.73 MB/s Jul 09 10:19:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:19:36 devstack sudo[104233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 1G Jul 09 10:19:36 devstack sudo[104233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:19:36 devstack sudo[104233]: pam_unix(sudo:session): session closed for user root Jul 09 10:19:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 1G" returned: 0 in 0.656s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:19:36 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d0b9b6-1625-4894-901d-27042856d287]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:19:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:19:36 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 Jul 09 10:19:36 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:19:37 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Jul 09 10:19:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8" returned: 0 in 0.728s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:19:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:19:37 devstack sudo[104242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 Jul 09 10:19:37 devstack sudo[104242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:19:38 devstack sudo[104242]: pam_unix(sudo:session): session closed for user root Jul 09 10:19:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8" returned: 1 in 0.724s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:19:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:19:38 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Downloaded image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}])) to volume 0b179537-55d1-4dab-ab23-70008570b8d8 successfully. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 10:19:38 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Temporary image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 for user 03eee91ce91643f0b85812b76e6a1970 is deleted. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 10:19:38 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Marking volume 0b179537-55d1-4dab-ab23-70008570b8d8 as bootable. {{(pid=87192) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 10:19:38 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Copying metadata from image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 to 0b179537-55d1-4dab-ab23-70008570b8d8. {{(pid=87192) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 10:19:38 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Creating volume glance metadata for volume 0b179537-55d1-4dab-ab23-70008570b8d8 backed by image fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87192) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 10:19:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d5f9b0a-20db-48d2-a2bc-20069482d694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b179537-55d1-4dab-ab23-70008570b8d8', 'volume_size': 1, 'image_id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'fbd1c6e24b394cf998d7f93c3a7d72f5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1', 'created_at': datetime.datetime(2026, 7, 9, 7, 52, 41, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 7, 52, 42, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/fa7e3e1d-94aa-4e9d-9686-9cd6ad72b4a1/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:19:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362ea827-ca5d-4cd8-8abc-dc4d4f4f3f92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:19:38 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Volume volume-0b179537-55d1-4dab-ab23-70008570b8d8 (0b179537-55d1-4dab-ab23-70008570b8d8): created successfully Jul 09 10:19:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362ea827-ca5d-4cd8-8abc-dc4d4f4f3f92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:19:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Flow 'volume_create_manager' (8f41491b-646e-4a43-bbfd-ea0dcf7084cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:19:38 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-bb811cd6-e55d-46cd-be44-c4f0aa4237e0 tempest-TestShelveInstance-1042254468 None] Created volume successfully. Jul 09 10:19:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-0b208565-4c60-449b-8711-325e124301cb req-2f0cdfd6-06e9-4c84-b1f2-8cee26a15034 tempest-TestShelveInstance-1042254468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:19:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-0b208565-4c60-449b-8711-325e124301cb req-2f0cdfd6-06e9-4c84-b1f2-8cee26a15034 tempest-TestShelveInstance-1042254468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:19:45 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0e278b3-8ade-485d-8b90-69192ce938a5]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:19:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-0b208565-4c60-449b-8711-325e124301cb req-2f0cdfd6-06e9-4c84-b1f2-8cee26a15034 tempest-TestShelveInstance-1042254468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:19:45 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 Jul 09 10:19:45 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:19:46 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Jul 09 10:19:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-0b208565-4c60-449b-8711-325e124301cb req-2f0cdfd6-06e9-4c84-b1f2-8cee26a15034 tempest-TestShelveInstance-1042254468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8" returned: 0 in 0.779s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:19:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-0b208565-4c60-449b-8711-325e124301cb req-2f0cdfd6-06e9-4c84-b1f2-8cee26a15034 tempest-TestShelveInstance-1042254468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:19:46 devstack sudo[104273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 Jul 09 10:19:46 devstack sudo[104273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:19:47 devstack sudo[104273]: pam_unix(sudo:session): session closed for user root Jul 09 10:19:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-0b208565-4c60-449b-8711-325e124301cb req-2f0cdfd6-06e9-4c84-b1f2-8cee26a15034 tempest-TestShelveInstance-1042254468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8" returned: 1 in 0.735s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:19:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-0b208565-4c60-449b-8711-325e124301cb req-2f0cdfd6-06e9-4c84-b1f2-8cee26a15034 tempest-TestShelveInstance-1042254468 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:19:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-0b208565-4c60-449b-8711-325e124301cb req-2f0cdfd6-06e9-4c84-b1f2-8cee26a15034 tempest-TestShelveInstance-1042254468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.556s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:19:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-0b208565-4c60-449b-8711-325e124301cb req-2f0cdfd6-06e9-4c84-b1f2-8cee26a15034 tempest-TestShelveInstance-1042254468 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-0b179537-55d1-4dab-ab23-70008570b8d8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '17ff2b3b-8e1f-4f67-bd9d-650e32f74c98', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:19:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-0b208565-4c60-449b-8711-325e124301cb req-2f0cdfd6-06e9-4c84-b1f2-8cee26a15034 tempest-TestShelveInstance-1042254468 None] attachment_update completed successfully. Jul 09 10:19:57 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=7,cinder:SELECT=14,cinder:INSERT=8,cinder:DELETE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:19:57 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=17,cinder:INSERT=6,cinder:UPDATE=6 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:20:23 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-70027a79-b689-4313-bdef-6747ad227e35 req-347b5de8-c684-425a-ad7b-0b5225475b23 tempest-TestShelveInstance-1042254468 None] Terminate volume connection completed successfully. Jul 09 10:20:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-70027a79-b689-4313-bdef-6747ad227e35 req-347b5de8-c684-425a-ad7b-0b5225475b23 tempest-TestShelveInstance-1042254468 None] Deleting attachment 17ff2b3b-8e1f-4f67-bd9d-650e32f74c98. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:20:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-8c470314-ae81-4cb8-af49-9342fa646bcb req-2e215240-932d-4f91-8f60-a602d2a09d88 tempest-TestShelveInstance-1042254468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:20:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-8c470314-ae81-4cb8-af49-9342fa646bcb req-2e215240-932d-4f91-8f60-a602d2a09d88 tempest-TestShelveInstance-1042254468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:20:28 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a8aea47-8b27-4551-84f6-805b6af1bec4]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:20:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-8c470314-ae81-4cb8-af49-9342fa646bcb req-2e215240-932d-4f91-8f60-a602d2a09d88 tempest-TestShelveInstance-1042254468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:20:28 devstack sudo[104879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 Jul 09 10:20:28 devstack sudo[104879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:20:29 devstack sudo[104879]: pam_unix(sudo:session): session closed for user root Jul 09 10:20:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-8c470314-ae81-4cb8-af49-9342fa646bcb req-2e215240-932d-4f91-8f60-a602d2a09d88 tempest-TestShelveInstance-1042254468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8" returned: 0 in 0.779s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:20:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-8c470314-ae81-4cb8-af49-9342fa646bcb req-2e215240-932d-4f91-8f60-a602d2a09d88 tempest-TestShelveInstance-1042254468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:20:29 devstack sudo[104883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 Jul 09 10:20:29 devstack sudo[104883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:20:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:20:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:20:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:20:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:20:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:20:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:20:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:20:29 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:20:29 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:20:30 devstack sudo[104883]: pam_unix(sudo:session): session closed for user root Jul 09 10:20:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-8c470314-ae81-4cb8-af49-9342fa646bcb req-2e215240-932d-4f91-8f60-a602d2a09d88 tempest-TestShelveInstance-1042254468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8" returned: 1 in 0.738s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:20:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-8c470314-ae81-4cb8-af49-9342fa646bcb req-2e215240-932d-4f91-8f60-a602d2a09d88 tempest-TestShelveInstance-1042254468 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:20:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-8c470314-ae81-4cb8-af49-9342fa646bcb req-2e215240-932d-4f91-8f60-a602d2a09d88 tempest-TestShelveInstance-1042254468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.557s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:20:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-8c470314-ae81-4cb8-af49-9342fa646bcb req-2e215240-932d-4f91-8f60-a602d2a09d88 tempest-TestShelveInstance-1042254468 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550', 'name': 'volume-0b179537-55d1-4dab-ab23-70008570b8d8', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '95915632-a220-49c2-bc40-33a840af7fb9', 'enforce_multipath': True} {{(pid=87192) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 09 10:20:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-8c470314-ae81-4cb8-af49-9342fa646bcb req-2e215240-932d-4f91-8f60-a602d2a09d88 tempest-TestShelveInstance-1042254468 None] attachment_update completed successfully. Jul 09 10:20:30 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Jul 09 10:20:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.682s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:20:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:20:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:20:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:20:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:20:40 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=7,cinder:UPDATE=2 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:20:40 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:21:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-fa0c9fe2-de56-420c-9f4e-a49ddf864e83 tempest-TestShelveInstance-1042254468 None] Terminate volume connection completed successfully. Jul 09 10:21:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-fa0c9fe2-de56-420c-9f4e-a49ddf864e83 tempest-TestShelveInstance-1042254468 None] Deleting attachment 95915632-a220-49c2-bc40-33a840af7fb9. {{(pid=87192) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 09 10:21:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] Acquiring lock "cinder-0b179537-55d1-4dab-ab23-70008570b8d8-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:21:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] Lock "cinder-0b179537-55d1-4dab-ab23-70008570b8d8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:21:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] Acquiring lock "cinder-quobyte-0b179537-55d1-4dab-ab23-70008570b8d8" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:21:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] Lock "cinder-quobyte-0b179537-55d1-4dab-ab23-70008570b8d8" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:21:07 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca50c261-0c26-43e1-8080-ef5eb1f19780]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:21:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:08 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 Jul 09 10:21:08 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:08 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8" returned: 0 in 0.784s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:08 devstack sudo[105456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 Jul 09 10:21:08 devstack sudo[105456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:09 devstack sudo[105456]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8" returned: 1 in 0.724s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:21:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:09 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8 Jul 09 10:21:09 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:10 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-0b179537-55d1-4dab-ab23-70008570b8d8" returned: 0 in 0.615s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] Lock "cinder-quobyte-0b179537-55d1-4dab-ab23-70008570b8d8" released by "delete_volume" :: held 2.184s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:21:10 devstack cinder-volume[87192]: DEBUG cinder.quota [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] Created reservations ['6687298a-fede-45d5-a823-5082ef98de7d', '3a11a92b-b8f3-47c8-8fa9-7a73d1548455', '5a2f9ca5-da4d-4c94-ab64-0b165ee446fd', '1f50aaab-638e-452f-a1c5-5a5e1c3ceee9'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:21:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:21:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:21:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:10 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:21:10 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:10 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.695s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:10 devstack cinder-volume[87192]: DEBUG cinder.manager [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:21:10 devstack cinder-volume[87192]: INFO cinder.volume.manager [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] Deleted volume successfully. Jul 09 10:21:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [req-743f5acf-cb97-47a9-a96e-7e8ca632dd28 req-3ca030c3-f3eb-41f2-b1ca-663ee921425d tempest-TestShelveInstance-1042254468 None] Lock "cinder-0b179537-55d1-4dab-ab23-70008570b8d8-delete_volume" released by "delete_volume" :: held 3.099s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=8,cinder:UPDATE=11,cinder:INSERT=2 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Flow 'volume_create_manager' (0fc728e2-42fc-47c3-a338-26b6d8b79844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df920d5-daee-4ebf-9140-be033fc864b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5df920d5-daee-4ebf-9140-be033fc864b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-350735024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e863021c-97a5-48e9-a905-15e15f6fb8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d6b577a1b0444ba2a20628862a9ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:21:21Z,use_quota=True,user_id='5731ec8244f540439ca832ac1f718317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6428a4cd-ca4c-40e1-9a99-7865ce9743a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6428a4cd-ca4c-40e1-9a99-7865ce9743a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f095a4cf-f9de-4e50-9fc9-d99816307475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f095a4cf-f9de-4e50-9fc9-d99816307475) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e863021c-97a5-48e9-a905-15e15f6fb8a1', 'volume_name': 'volume-e863021c-97a5-48e9-a905-15e15f6fb8a1', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba95fa9-31f5-43ed-8596-68ac82ef4e74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ba95fa9-31f5-43ed-8596-68ac82ef4e74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b40986a-ae33-49d1-ad36-bfeb3c766964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:20 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Volume e863021c-97a5-48e9-a905-15e15f6fb8a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e863021c-97a5-48e9-a905-15e15f6fb8a1', 'volume_size': 1} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:21:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-350735024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e863021c-97a5-48e9-a905-15e15f6fb8a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d6b577a1b0444ba2a20628862a9ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:21:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:21:21Z,use_quota=True,user_id='5731ec8244f540439ca832ac1f718317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Creating volume e863021c-97a5-48e9-a905-15e15f6fb8a1 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:21:20 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:21:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:20 devstack sudo[105474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1 1073741824 Jul 09 10:21:20 devstack sudo[105474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:21 devstack sudo[105474]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1 1073741824" returned: 0 in 0.799s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:21 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1 Jul 09 10:21:21 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:22 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1" returned: 0 in 0.626s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] <== create_volume: return (1467ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:21:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.469s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b40986a-ae33-49d1-ad36-bfeb3c766964) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e863021c-97a5-48e9-a905-15e15f6fb8a1', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136f8995-bb8c-42f0-ade6-f3d19140c759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:22 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Volume volume-e863021c-97a5-48e9-a905-15e15f6fb8a1 (e863021c-97a5-48e9-a905-15e15f6fb8a1): created successfully Jul 09 10:21:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (136f8995-bb8c-42f0-ade6-f3d19140c759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Flow 'volume_create_manager' (0fc728e2-42fc-47c3-a338-26b6d8b79844) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:21:22 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-fb081e37-fd1a-42ca-9d13-8371c78c96f7 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Created volume successfully. Jul 09 10:21:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8e68d28a-b6eb-4acd-b9eb-1f7ab912c93a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8e68d28a-b6eb-4acd-b9eb-1f7ab912c93a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8e68d28a-b6eb-4acd-b9eb-1f7ab912c93a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Creating offline snapshot 6f328c21-0078-4190-903a-e27ade927896 of volume e863021c-97a5-48e9-a905-15e15f6fb8a1 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:21:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[18b927ae-a6e6-4eda-a76f-7da658cb4f12]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:21:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8e68d28a-b6eb-4acd-b9eb-1f7ab912c93a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:23 devstack sudo[105483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1 Jul 09 10:21:23 devstack sudo[105483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:23 devstack sudo[105483]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8e68d28a-b6eb-4acd-b9eb-1f7ab912c93a tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1" returned: 0 in 0.733s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8e68d28a-b6eb-4acd-b9eb-1f7ab912c93a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.6f328c21-0078-4190-903a-e27ade927896 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:23 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.6f328c21-0078-4190-903a-e27ade927896 1G Jul 09 10:21:23 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:24 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8e68d28a-b6eb-4acd-b9eb-1f7ab912c93a tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.6f328c21-0078-4190-903a-e27ade927896 1G" returned: 0 in 0.763s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8e68d28a-b6eb-4acd-b9eb-1f7ab912c93a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e863021c-97a5-48e9-a905-15e15f6fb8a1 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.6f328c21-0078-4190-903a-e27ade927896 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:24 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e863021c-97a5-48e9-a905-15e15f6fb8a1 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.6f328c21-0078-4190-903a-e27ade927896 Jul 09 10:21:24 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:25 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8e68d28a-b6eb-4acd-b9eb-1f7ab912c93a tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e863021c-97a5-48e9-a905-15e15f6fb8a1 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.6f328c21-0078-4190-903a-e27ade927896" returned: 0 in 0.674s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:25 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-8e68d28a-b6eb-4acd-b9eb-1f7ab912c93a tempest-CreateVolumesFromSnapshotTest-1898369248 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.6f328c21-0078-4190-903a-e27ade927896 is being set with open permissions: ugo+rw Jul 09 10:21:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8e68d28a-b6eb-4acd-b9eb-1f7ab912c93a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.6f328c21-0078-4190-903a-e27ade927896 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:25 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.6f328c21-0078-4190-903a-e27ade927896 Jul 09 10:21:25 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:25 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8e68d28a-b6eb-4acd-b9eb-1f7ab912c93a tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.6f328c21-0078-4190-903a-e27ade927896" returned: 0 in 0.613s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8e68d28a-b6eb-4acd-b9eb-1f7ab912c93a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:25 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.info Jul 09 10:21:25 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:26 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8e68d28a-b6eb-4acd-b9eb-1f7ab912c93a tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.info" returned: 0 in 0.635s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:26 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-8e68d28a-b6eb-4acd-b9eb-1f7ab912c93a tempest-CreateVolumesFromSnapshotTest-1898369248 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.info is being set with open permissions: ugo+rw Jul 09 10:21:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8e68d28a-b6eb-4acd-b9eb-1f7ab912c93a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:26 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.info Jul 09 10:21:26 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:26 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8e68d28a-b6eb-4acd-b9eb-1f7ab912c93a tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.info" returned: 0 in 0.624s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8e68d28a-b6eb-4acd-b9eb-1f7ab912c93a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.123s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:27 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8e68d28a-b6eb-4acd-b9eb-1f7ab912c93a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Create snapshot completed successfully Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Flow 'volume_create_manager' (9e3bbdfe-4cb8-419d-a718-30f8e6ea2d2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac37dc0-f940-4316-909c-daf6a347a537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bac37dc0-f940-4316-909c-daf6a347a537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-87881445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a6471c3-f381-4899-9250-a494f77d56a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d6b577a1b0444ba2a20628862a9ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:21:28Z,use_quota=True,user_id='5731ec8244f540439ca832ac1f718317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f580c0d-4390-4877-9639-2ff03791e39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f580c0d-4390-4877-9639-2ff03791e39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc06508-53f9-463c-bc90-a7367e819c86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc06508-53f9-463c-bc90-a7367e819c86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4a6471c3-f381-4899-9250-a494f77d56a6', 'volume_name': 'volume-4a6471c3-f381-4899-9250-a494f77d56a6', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c68543e-d459-479f-8054-721b8d67ba60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c68543e-d459-479f-8054-721b8d67ba60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc876e4-02d2-49f6-bb04-637b2318eb00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:28 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Volume 4a6471c3-f381-4899-9250-a494f77d56a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4a6471c3-f381-4899-9250-a494f77d56a6', 'volume_size': 1} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:21:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-87881445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a6471c3-f381-4899-9250-a494f77d56a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d6b577a1b0444ba2a20628862a9ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:21:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:21:28Z,use_quota=True,user_id='5731ec8244f540439ca832ac1f718317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Creating volume 4a6471c3-f381-4899-9250-a494f77d56a6 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:21:28 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4a6471c3-f381-4899-9250-a494f77d56a6 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:28 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4a6471c3-f381-4899-9250-a494f77d56a6 1073741824 Jul 09 10:21:28 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Flow 'volume_create_manager' (1d0573f3-2c83-4611-9fb7-2859c69fe0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d0f6b1-a41a-4325-8e4e-8319add6de9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84d0f6b1-a41a-4325-8e4e-8319add6de9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2041602573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376bfba7-ffe8-4d7f-bba8-7a62667272ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d6b577a1b0444ba2a20628862a9ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:21:29Z,use_quota=True,user_id='5731ec8244f540439ca832ac1f718317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c91e58a-ea98-4264-8e50-73691cd50606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c91e58a-ea98-4264-8e50-73691cd50606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922a46be-e605-4470-89de-b586ad18d2a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (922a46be-e605-4470-89de-b586ad18d2a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '376bfba7-ffe8-4d7f-bba8-7a62667272ac', 'volume_name': 'volume-376bfba7-ffe8-4d7f-bba8-7a62667272ac', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc796fa-b16c-433e-89cd-27822b079e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc796fa-b16c-433e-89cd-27822b079e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe654c49-69a0-447f-a911-22cd34e3bea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:28 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Volume 376bfba7-ffe8-4d7f-bba8-7a62667272ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-376bfba7-ffe8-4d7f-bba8-7a62667272ac', 'volume_size': 1} Jul 09 10:21:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Flow 'volume_create_manager' (4e5cab5d-4db0-4062-a02f-8eb65f3b7589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1040a71b-4e7b-41e8-8f39-9d725c76897c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1040a71b-4e7b-41e8-8f39-9d725c76897c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1777126717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=440b60e7-685d-4755-a3ed-51fe0da1c26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d6b577a1b0444ba2a20628862a9ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:21:29Z,use_quota=True,user_id='5731ec8244f540439ca832ac1f718317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c47166-990c-4165-af35-cbcbfb235e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95c47166-990c-4165-af35-cbcbfb235e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d827418-920a-40fb-9764-b241ce3c2e6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d827418-920a-40fb-9764-b241ce3c2e6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '440b60e7-685d-4755-a3ed-51fe0da1c26a', 'volume_name': 'volume-440b60e7-685d-4755-a3ed-51fe0da1c26a', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6464742e-00ed-4966-88fe-34fc6266f0ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6464742e-00ed-4966-88fe-34fc6266f0ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20675bad-0439-4f98-9b7d-636b7e0a873b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:29 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Volume 440b60e7-685d-4755-a3ed-51fe0da1c26a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-440b60e7-685d-4755-a3ed-51fe0da1c26a', 'volume_size': 1} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:29 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4a6471c3-f381-4899-9250-a494f77d56a6 1073741824" returned: 0 in 0.978s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4a6471c3-f381-4899-9250-a494f77d56a6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:29 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4a6471c3-f381-4899-9250-a494f77d56a6 Jul 09 10:21:29 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Flow 'volume_create_manager' (0f167e1f-50be-46fc-b7b4-de392f50fab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a81bbbf-d371-43b0-b49a-bfc14ba684a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a81bbbf-d371-43b0-b49a-bfc14ba684a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-224417198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6433e3-b09d-4756-90c0-8c10f3e48d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d6b577a1b0444ba2a20628862a9ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:21:30Z,use_quota=True,user_id='5731ec8244f540439ca832ac1f718317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a816eb-549e-4242-9fa4-5b9206349731) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3a816eb-549e-4242-9fa4-5b9206349731) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944e7d8b-b9f1-4c7f-ada6-e8d29e126d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (944e7d8b-b9f1-4c7f-ada6-e8d29e126d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc6433e3-b09d-4756-90c0-8c10f3e48d04', 'volume_name': 'volume-dc6433e3-b09d-4756-90c0-8c10f3e48d04', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5e21d6-e53c-4764-b9d9-e66e84f02772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f5e21d6-e53c-4764-b9d9-e66e84f02772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5dc2a2-b6cd-47a4-a57f-1f3d54232441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:29 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Volume dc6433e3-b09d-4756-90c0-8c10f3e48d04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc6433e3-b09d-4756-90c0-8c10f3e48d04', 'volume_size': 1} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:29 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:21:29 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Flow 'volume_create_manager' (58db5feb-43df-4aa8-a35f-185bffd40d87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404594cb-74b7-4883-92e7-6c929b05e63b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (404594cb-74b7-4883-92e7-6c929b05e63b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1495069656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cd5aa9-0c8e-40d2-9edf-98d40126d82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d6b577a1b0444ba2a20628862a9ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:21:30Z,use_quota=True,user_id='5731ec8244f540439ca832ac1f718317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c28968-14fd-4066-80e4-2158e81be638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8c28968-14fd-4066-80e4-2158e81be638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3352ace2-5421-4129-a22c-484691f88a9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3352ace2-5421-4129-a22c-484691f88a9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0cd5aa9-0c8e-40d2-9edf-98d40126d82d', 'volume_name': 'volume-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a218ea01-4b89-4989-b5d3-4ed83232f193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a218ea01-4b89-4989-b5d3-4ed83232f193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f8b8a1-eea4-42f3-b8e2-0329aec67ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:30 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Volume f0cd5aa9-0c8e-40d2-9edf-98d40126d82d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d', 'volume_size': 1} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:30 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4a6471c3-f381-4899-9250-a494f77d56a6" returned: 0 in 0.798s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] <== create_volume: return (1825ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.827s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.471s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2041602573',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=376bfba7-ffe8-4d7f-bba8-7a62667272ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d6b577a1b0444ba2a20628862a9ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:21:29Z,use_quota=True,user_id='5731ec8244f540439ca832ac1f718317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Creating volume 376bfba7-ffe8-4d7f-bba8-7a62667272ac {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:21:30 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-376bfba7-ffe8-4d7f-bba8-7a62667272ac 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1dc876e4-02d2-49f6-bb04-637b2318eb00) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a6471c3-f381-4899-9250-a494f77d56a6', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92031c0e-d289-4d2b-aa71-3d743970c539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:30 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-376bfba7-ffe8-4d7f-bba8-7a62667272ac 1073741824 Jul 09 10:21:30 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:30 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Volume volume-4a6471c3-f381-4899-9250-a494f77d56a6 (4a6471c3-f381-4899-9250-a494f77d56a6): created successfully Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92031c0e-d289-4d2b-aa71-3d743970c539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Flow 'volume_create_manager' (9e3bbdfe-4cb8-419d-a718-30f8e6ea2d2e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:21:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5a7bd921-fb9c-4fec-90ab-d51b94d545d3 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Created volume successfully. Jul 09 10:21:30 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.736s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:21:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:21:31 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-376bfba7-ffe8-4d7f-bba8-7a62667272ac 1073741824" returned: 0 in 0.849s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-376bfba7-ffe8-4d7f-bba8-7a62667272ac {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:31 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-376bfba7-ffe8-4d7f-bba8-7a62667272ac Jul 09 10:21:31 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:31 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-376bfba7-ffe8-4d7f-bba8-7a62667272ac" returned: 0 in 0.625s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:21:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.578s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1777126717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=440b60e7-685d-4755-a3ed-51fe0da1c26a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d6b577a1b0444ba2a20628862a9ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:21:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:21:29Z,use_quota=True,user_id='5731ec8244f540439ca832ac1f718317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:21:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Creating volume 440b60e7-685d-4755-a3ed-51fe0da1c26a {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:21:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:21:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:21:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:21:31 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:21:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-440b60e7-685d-4755-a3ed-51fe0da1c26a 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe654c49-69a0-447f-a911-22cd34e3bea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-376bfba7-ffe8-4d7f-bba8-7a62667272ac', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:31 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-440b60e7-685d-4755-a3ed-51fe0da1c26a 1073741824 Jul 09 10:21:31 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f818081d-dcc0-493c-b8c6-3faab4644824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:31 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Volume volume-376bfba7-ffe8-4d7f-bba8-7a62667272ac (376bfba7-ffe8-4d7f-bba8-7a62667272ac): created successfully Jul 09 10:21:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f818081d-dcc0-493c-b8c6-3faab4644824) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Flow 'volume_create_manager' (1d0573f3-2c83-4611-9fb7-2859c69fe0fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:21:32 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2fb50157-7816-4e1f-8c38-0ce05f763c0b tempest-CreateVolumesFromSnapshotTest-1898369248 None] Created volume successfully. Jul 09 10:21:32 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-440b60e7-685d-4755-a3ed-51fe0da1c26a 1073741824" returned: 0 in 0.812s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-440b60e7-685d-4755-a3ed-51fe0da1c26a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:32 devstack sudo[105534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-440b60e7-685d-4755-a3ed-51fe0da1c26a Jul 09 10:21:32 devstack sudo[105534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:33 devstack sudo[105534]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-440b60e7-685d-4755-a3ed-51fe0da1c26a" returned: 0 in 0.652s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] <== create_volume: return (1501ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:21:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.504s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.691s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-224417198',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6433e3-b09d-4756-90c0-8c10f3e48d04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d6b577a1b0444ba2a20628862a9ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:21:30Z,use_quota=True,user_id='5731ec8244f540439ca832ac1f718317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:21:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Creating volume dc6433e3-b09d-4756-90c0-8c10f3e48d04 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:21:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:21:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:21:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:21:33 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:21:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-dc6433e3-b09d-4756-90c0-8c10f3e48d04 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (20675bad-0439-4f98-9b7d-636b7e0a873b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-440b60e7-685d-4755-a3ed-51fe0da1c26a', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:33 devstack sudo[105537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-dc6433e3-b09d-4756-90c0-8c10f3e48d04 1073741824 Jul 09 10:21:33 devstack sudo[105537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b19bfe-e720-4e0c-9ab9-95730c4ff42b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:33 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Volume volume-440b60e7-685d-4755-a3ed-51fe0da1c26a (440b60e7-685d-4755-a3ed-51fe0da1c26a): created successfully Jul 09 10:21:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2b19bfe-e720-4e0c-9ab9-95730c4ff42b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Flow 'volume_create_manager' (4e5cab5d-4db0-4062-a02f-8eb65f3b7589) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:21:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e6d5a6c0-d672-4409-9d38-fca24babd3e1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Created volume successfully. Jul 09 10:21:34 devstack sudo[105537]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-dc6433e3-b09d-4756-90c0-8c10f3e48d04 1073741824" returned: 0 in 0.793s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-dc6433e3-b09d-4756-90c0-8c10f3e48d04 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:34 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-dc6433e3-b09d-4756-90c0-8c10f3e48d04 Jul 09 10:21:34 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:34 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-dc6433e3-b09d-4756-90c0-8c10f3e48d04" returned: 0 in 0.631s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] <== create_volume: return (1464ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:21:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.692s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:21:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1495069656',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0cd5aa9-0c8e-40d2-9edf-98d40126d82d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2d6b577a1b0444ba2a20628862a9ac0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:21:30Z,use_quota=True,user_id='5731ec8244f540439ca832ac1f718317',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:21:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Creating volume f0cd5aa9-0c8e-40d2-9edf-98d40126d82d {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:21:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:21:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:21:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:21:34 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:21:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5dc2a2-b6cd-47a4-a57f-1f3d54232441) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc6433e3-b09d-4756-90c0-8c10f3e48d04', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:34 devstack sudo[105545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d 1073741824 Jul 09 10:21:34 devstack sudo[105545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b00414-714a-4b48-9b9d-aff56ffb5039) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:34 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Volume volume-dc6433e3-b09d-4756-90c0-8c10f3e48d04 (dc6433e3-b09d-4756-90c0-8c10f3e48d04): created successfully Jul 09 10:21:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b00414-714a-4b48-9b9d-aff56ffb5039) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Flow 'volume_create_manager' (0f167e1f-50be-46fc-b7b4-de392f50fab1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:21:34 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b5c6f7c4-5bf1-483c-88bd-f65afaa43d10 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Created volume successfully. Jul 09 10:21:35 devstack sudo[105545]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d 1073741824" returned: 0 in 0.812s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:35 devstack sudo[105586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d Jul 09 10:21:35 devstack sudo[105586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:36 devstack sudo[105586]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d" returned: 0 in 0.640s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:21:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.491s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0f8b8a1-eea4-42f3-b8e2-0329aec67ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dc47dfc-0052-4fb7-a804-7a5a615d1ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:36 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Volume volume-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d (f0cd5aa9-0c8e-40d2-9edf-98d40126d82d): created successfully Jul 09 10:21:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dc47dfc-0052-4fb7-a804-7a5a615d1ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Flow 'volume_create_manager' (58db5feb-43df-4aa8-a35f-185bffd40d87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:21:36 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-56e5fe80-a6f3-4b8e-bbc7-65c84f4b2b3a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Created volume successfully. Jul 09 10:21:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-28827150-477c-4b3e-8aef-d834775558f2 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "cinder-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:21:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-28827150-477c-4b3e-8aef-d834775558f2 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:21:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-28827150-477c-4b3e-8aef-d834775558f2 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "cinder-quobyte-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:21:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-28827150-477c-4b3e-8aef-d834775558f2 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-quobyte-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d" acquired by "delete_volume" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:21:36 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[340897a7-f16b-4dfa-9eb6-794a3db3aed5]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:21:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-28827150-477c-4b3e-8aef-d834775558f2 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:36 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d Jul 09 10:21:36 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:37 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-28827150-477c-4b3e-8aef-d834775558f2 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d" returned: 0 in 0.723s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-28827150-477c-4b3e-8aef-d834775558f2 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:37 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d Jul 09 10:21:37 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:38 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-28827150-477c-4b3e-8aef-d834775558f2 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d" returned: 0 in 0.624s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-28827150-477c-4b3e-8aef-d834775558f2 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-quobyte-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d" released by "delete_volume" :: held 1.385s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:21:38 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-28827150-477c-4b3e-8aef-d834775558f2 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Created reservations ['f4a257f6-751c-42e2-a0e8-a2f92911278a', '5d611f50-73c1-4df1-bf71-8d830893c341', '46d576fb-a7bc-4951-80b6-4f343a88e861', '45871fe9-51aa-47f6-96c0-e3085da757ad'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:21:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-28827150-477c-4b3e-8aef-d834775558f2 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-28827150-477c-4b3e-8aef-d834775558f2 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-28827150-477c-4b3e-8aef-d834775558f2 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:21:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-28827150-477c-4b3e-8aef-d834775558f2 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:21:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-28827150-477c-4b3e-8aef-d834775558f2 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-28827150-477c-4b3e-8aef-d834775558f2 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:38 devstack sudo[105597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:21:38 devstack sudo[105597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:38 devstack sudo[105597]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6c53e626-725a-42e4-b1fc-b52e2a3b8153 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "cinder-dc6433e3-b09d-4756-90c0-8c10f3e48d04-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:21:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-28827150-477c-4b3e-8aef-d834775558f2 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.650s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:38 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-28827150-477c-4b3e-8aef-d834775558f2 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:21:38 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-28827150-477c-4b3e-8aef-d834775558f2 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Deleted volume successfully. Jul 09 10:21:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6c53e626-725a-42e4-b1fc-b52e2a3b8153 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-dc6433e3-b09d-4756-90c0-8c10f3e48d04-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:21:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-28827150-477c-4b3e-8aef-d834775558f2 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-f0cd5aa9-0c8e-40d2-9edf-98d40126d82d-delete_volume" released by "delete_volume" :: held 2.232s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:21:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6c53e626-725a-42e4-b1fc-b52e2a3b8153 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "cinder-quobyte-dc6433e3-b09d-4756-90c0-8c10f3e48d04" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:21:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6c53e626-725a-42e4-b1fc-b52e2a3b8153 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-quobyte-dc6433e3-b09d-4756-90c0-8c10f3e48d04" acquired by "delete_volume" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:21:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4f2657-ecf7-4870-9790-d0cb0593b5ce]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:21:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c53e626-725a-42e4-b1fc-b52e2a3b8153 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-dc6433e3-b09d-4756-90c0-8c10f3e48d04 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:39 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-dc6433e3-b09d-4756-90c0-8c10f3e48d04 Jul 09 10:21:39 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:39 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c53e626-725a-42e4-b1fc-b52e2a3b8153 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-dc6433e3-b09d-4756-90c0-8c10f3e48d04" returned: 0 in 0.726s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c53e626-725a-42e4-b1fc-b52e2a3b8153 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-dc6433e3-b09d-4756-90c0-8c10f3e48d04 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:39 devstack sudo[105606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-dc6433e3-b09d-4756-90c0-8c10f3e48d04 Jul 09 10:21:39 devstack sudo[105606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:40 devstack sudo[105606]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c53e626-725a-42e4-b1fc-b52e2a3b8153 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-dc6433e3-b09d-4756-90c0-8c10f3e48d04" returned: 0 in 0.642s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6c53e626-725a-42e4-b1fc-b52e2a3b8153 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-quobyte-dc6433e3-b09d-4756-90c0-8c10f3e48d04" released by "delete_volume" :: held 1.403s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:21:40 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-6c53e626-725a-42e4-b1fc-b52e2a3b8153 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Created reservations ['e6f57aee-95c6-446c-9ad9-77d96e03d319', '8c74bb42-f8c4-4a9b-b03b-15a358946400', 'ad625cd1-d063-41a5-8429-ab75579c5104', '1748b351-2876-4425-baba-7e6004a5bc91'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:21:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c53e626-725a-42e4-b1fc-b52e2a3b8153 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c53e626-725a-42e4-b1fc-b52e2a3b8153 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6c53e626-725a-42e4-b1fc-b52e2a3b8153 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:21:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6c53e626-725a-42e4-b1fc-b52e2a3b8153 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:21:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c53e626-725a-42e4-b1fc-b52e2a3b8153 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c53e626-725a-42e4-b1fc-b52e2a3b8153 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:40 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:21:40 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-582d21c1-46c1-460b-8bfe-941e283058b1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "cinder-440b60e7-685d-4755-a3ed-51fe0da1c26a-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:21:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-582d21c1-46c1-460b-8bfe-941e283058b1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-440b60e7-685d-4755-a3ed-51fe0da1c26a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:21:41 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c53e626-725a-42e4-b1fc-b52e2a3b8153 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.668s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:41 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-6c53e626-725a-42e4-b1fc-b52e2a3b8153 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:21:41 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6c53e626-725a-42e4-b1fc-b52e2a3b8153 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Deleted volume successfully. Jul 09 10:21:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6c53e626-725a-42e4-b1fc-b52e2a3b8153 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-dc6433e3-b09d-4756-90c0-8c10f3e48d04-delete_volume" released by "delete_volume" :: held 2.272s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:21:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-582d21c1-46c1-460b-8bfe-941e283058b1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "cinder-quobyte-440b60e7-685d-4755-a3ed-51fe0da1c26a" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:21:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-582d21c1-46c1-460b-8bfe-941e283058b1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-quobyte-440b60e7-685d-4755-a3ed-51fe0da1c26a" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:21:41 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[efb5ca08-2dd1-466e-9a1d-e9cc71033c64]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:21:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-582d21c1-46c1-460b-8bfe-941e283058b1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-440b60e7-685d-4755-a3ed-51fe0da1c26a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:41 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-440b60e7-685d-4755-a3ed-51fe0da1c26a Jul 09 10:21:41 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:41 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-582d21c1-46c1-460b-8bfe-941e283058b1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-440b60e7-685d-4755-a3ed-51fe0da1c26a" returned: 0 in 0.740s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-582d21c1-46c1-460b-8bfe-941e283058b1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-440b60e7-685d-4755-a3ed-51fe0da1c26a {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:41 devstack sudo[105617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-440b60e7-685d-4755-a3ed-51fe0da1c26a Jul 09 10:21:41 devstack sudo[105617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:42 devstack sudo[105617]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-582d21c1-46c1-460b-8bfe-941e283058b1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-440b60e7-685d-4755-a3ed-51fe0da1c26a" returned: 0 in 0.663s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-582d21c1-46c1-460b-8bfe-941e283058b1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-quobyte-440b60e7-685d-4755-a3ed-51fe0da1c26a" released by "delete_volume" :: held 1.437s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:21:42 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-582d21c1-46c1-460b-8bfe-941e283058b1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Created reservations ['323717a7-4d06-4dda-a5fd-2f5fe4efe4ba', '28507827-5830-4eb6-b7de-443522ad77c5', '974adfb2-0894-41cd-9be1-317a48ae48a6', '9786cdb3-b615-4dbb-bf01-e50a4dfb6779'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:21:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-582d21c1-46c1-460b-8bfe-941e283058b1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-582d21c1-46c1-460b-8bfe-941e283058b1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-582d21c1-46c1-460b-8bfe-941e283058b1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:21:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-582d21c1-46c1-460b-8bfe-941e283058b1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:21:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-582d21c1-46c1-460b-8bfe-941e283058b1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-582d21c1-46c1-460b-8bfe-941e283058b1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:42 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:21:42 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-668fc384-3930-43d4-b31a-c5ded57adf41 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "cinder-376bfba7-ffe8-4d7f-bba8-7a62667272ac-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:21:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-668fc384-3930-43d4-b31a-c5ded57adf41 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-376bfba7-ffe8-4d7f-bba8-7a62667272ac-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:21:43 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-582d21c1-46c1-460b-8bfe-941e283058b1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.638s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:43 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-582d21c1-46c1-460b-8bfe-941e283058b1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:21:43 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-582d21c1-46c1-460b-8bfe-941e283058b1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Deleted volume successfully. Jul 09 10:21:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-668fc384-3930-43d4-b31a-c5ded57adf41 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "cinder-quobyte-376bfba7-ffe8-4d7f-bba8-7a62667272ac" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:21:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-582d21c1-46c1-460b-8bfe-941e283058b1 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-440b60e7-685d-4755-a3ed-51fe0da1c26a-delete_volume" released by "delete_volume" :: held 2.297s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:21:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-668fc384-3930-43d4-b31a-c5ded57adf41 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-quobyte-376bfba7-ffe8-4d7f-bba8-7a62667272ac" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:21:43 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d89dbbd2-9035-41e3-9019-216fa62d9e01]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:21:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-668fc384-3930-43d4-b31a-c5ded57adf41 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-376bfba7-ffe8-4d7f-bba8-7a62667272ac {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:43 devstack sudo[105631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-376bfba7-ffe8-4d7f-bba8-7a62667272ac Jul 09 10:21:43 devstack sudo[105631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:44 devstack sudo[105631]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-668fc384-3930-43d4-b31a-c5ded57adf41 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-376bfba7-ffe8-4d7f-bba8-7a62667272ac" returned: 0 in 0.751s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-668fc384-3930-43d4-b31a-c5ded57adf41 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-376bfba7-ffe8-4d7f-bba8-7a62667272ac {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:44 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-376bfba7-ffe8-4d7f-bba8-7a62667272ac Jul 09 10:21:44 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:44 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-668fc384-3930-43d4-b31a-c5ded57adf41 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-376bfba7-ffe8-4d7f-bba8-7a62667272ac" returned: 0 in 0.618s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-668fc384-3930-43d4-b31a-c5ded57adf41 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-quobyte-376bfba7-ffe8-4d7f-bba8-7a62667272ac" released by "delete_volume" :: held 1.405s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:21:44 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-668fc384-3930-43d4-b31a-c5ded57adf41 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Created reservations ['12cb0e41-f172-4e33-a20e-7c929b2aa8d0', '3eae5177-6092-4fcc-9a3f-537ada34427b', '0d16bed0-4c2e-46cd-b162-63b8affaabe7', '934351a7-c0ed-4aba-9169-afaa135ad055'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:21:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-668fc384-3930-43d4-b31a-c5ded57adf41 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-668fc384-3930-43d4-b31a-c5ded57adf41 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-668fc384-3930-43d4-b31a-c5ded57adf41 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:21:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-668fc384-3930-43d4-b31a-c5ded57adf41 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:21:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-668fc384-3930-43d4-b31a-c5ded57adf41 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-668fc384-3930-43d4-b31a-c5ded57adf41 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:44 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:21:44 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1c44c547-ffb5-4a2f-8750-71dc52cce628 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "cinder-4a6471c3-f381-4899-9250-a494f77d56a6-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:21:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1c44c547-ffb5-4a2f-8750-71dc52cce628 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-4a6471c3-f381-4899-9250-a494f77d56a6-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:21:45 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-668fc384-3930-43d4-b31a-c5ded57adf41 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.657s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:45 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-668fc384-3930-43d4-b31a-c5ded57adf41 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:21:45 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-668fc384-3930-43d4-b31a-c5ded57adf41 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Deleted volume successfully. Jul 09 10:21:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1c44c547-ffb5-4a2f-8750-71dc52cce628 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "cinder-quobyte-4a6471c3-f381-4899-9250-a494f77d56a6" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:21:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1c44c547-ffb5-4a2f-8750-71dc52cce628 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-quobyte-4a6471c3-f381-4899-9250-a494f77d56a6" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:21:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-668fc384-3930-43d4-b31a-c5ded57adf41 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-376bfba7-ffe8-4d7f-bba8-7a62667272ac-delete_volume" released by "delete_volume" :: held 2.300s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:21:45 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1929b141-b7bb-4044-be04-48ce740ce8a4]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:21:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1c44c547-ffb5-4a2f-8750-71dc52cce628 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4a6471c3-f381-4899-9250-a494f77d56a6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:45 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4a6471c3-f381-4899-9250-a494f77d56a6 Jul 09 10:21:45 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:46 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1c44c547-ffb5-4a2f-8750-71dc52cce628 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4a6471c3-f381-4899-9250-a494f77d56a6" returned: 0 in 0.732s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1c44c547-ffb5-4a2f-8750-71dc52cce628 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4a6471c3-f381-4899-9250-a494f77d56a6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:46 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4a6471c3-f381-4899-9250-a494f77d56a6 Jul 09 10:21:46 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:46 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1c44c547-ffb5-4a2f-8750-71dc52cce628 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4a6471c3-f381-4899-9250-a494f77d56a6" returned: 0 in 0.613s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1c44c547-ffb5-4a2f-8750-71dc52cce628 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-quobyte-4a6471c3-f381-4899-9250-a494f77d56a6" released by "delete_volume" :: held 1.383s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:21:47 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-1c44c547-ffb5-4a2f-8750-71dc52cce628 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Created reservations ['a34b689f-c55b-44a8-a1d8-82cc23d0ab79', 'cfbe060a-8c0a-489c-b07b-073c32f6e7f8', '2055f43e-f295-4634-9416-1c92ba107c3d', '379c799b-8c46-4bfa-aafe-e30d49227332'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:21:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1c44c547-ffb5-4a2f-8750-71dc52cce628 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1c44c547-ffb5-4a2f-8750-71dc52cce628 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1c44c547-ffb5-4a2f-8750-71dc52cce628 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:21:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1c44c547-ffb5-4a2f-8750-71dc52cce628 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:21:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1c44c547-ffb5-4a2f-8750-71dc52cce628 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1c44c547-ffb5-4a2f-8750-71dc52cce628 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:47 devstack sudo[105650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:21:47 devstack sudo[105650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:47 devstack sudo[105650]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1c44c547-ffb5-4a2f-8750-71dc52cce628 tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.619s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:47 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-1c44c547-ffb5-4a2f-8750-71dc52cce628 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:21:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1c44c547-ffb5-4a2f-8750-71dc52cce628 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Deleted volume successfully. Jul 09 10:21:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "cinder-6f328c21-0078-4190-903a-e27ade927896-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:21:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1c44c547-ffb5-4a2f-8750-71dc52cce628 tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-4a6471c3-f381-4899-9250-a494f77d56a6-delete_volume" released by "delete_volume" :: held 2.214s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:21:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-6f328c21-0078-4190-903a-e27ade927896-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:21:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "cinder-quobyte-e863021c-97a5-48e9-a905-15e15f6fb8a1" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:21:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-quobyte-e863021c-97a5-48e9-a905-15e15f6fb8a1" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:21:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "cinder-quobyte-6f328c21-0078-4190-903a-e27ade927896" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:21:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-quobyte-6f328c21-0078-4190-903a-e27ade927896" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:21:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] Deleting offline snapshot 6f328c21-0078-4190-903a-e27ade927896 of volume e863021c-97a5-48e9-a905-15e15f6fb8a1 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:21:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] snapshot_file for this snap is: volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.6f328c21-0078-4190-903a-e27ade927896 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:21:47 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fcef0b8-964e-4ae8-88af-cbc9ca3adf39]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:21:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.6f328c21-0078-4190-903a-e27ade927896 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:47 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.6f328c21-0078-4190-903a-e27ade927896 Jul 09 10:21:47 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:48 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.6f328c21-0078-4190-903a-e27ade927896" returned: 0 in 0.734s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e863021c-97a5-48e9-a905-15e15f6fb8a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:21:48 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f389ef-9124-4109-a068-4dd20a9861fd]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:21:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:48 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1 Jul 09 10:21:48 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:49 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1" returned: 0 in 0.725s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.6f328c21-0078-4190-903a-e27ade927896 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:49 devstack sudo[105665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.6f328c21-0078-4190-903a-e27ade927896 Jul 09 10:21:49 devstack sudo[105665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:49 devstack sudo[105665]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.6f328c21-0078-4190-903a-e27ade927896" returned: 0 in 0.695s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.6f328c21-0078-4190-903a-e27ade927896 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:50 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.6f328c21-0078-4190-903a-e27ade927896 Jul 09 10:21:50 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:50 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1.6f328c21-0078-4190-903a-e27ade927896" returned: 0 in 0.618s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-quobyte-6f328c21-0078-4190-903a-e27ade927896" released by "_delete_snapshot" :: held 2.866s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:21:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-quobyte-e863021c-97a5-48e9-a905-15e15f6fb8a1" released by "delete_snapshot" :: held 2.885s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:21:50 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] Created reservations ['12d55f2a-c67d-4250-a8a1-d2509348a890', '828b80df-8eee-4332-9462-6bea2a5ee72a', '15344baa-d86a-4203-aea5-e8d9b9dcefe4', '6a6d32f3-8d35-4812-9ae9-a105ec1b2842'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:21:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] Delete snapshot completed successfully. Jul 09 10:21:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-67bc2dcf-0a31-4235-8125-554fdb9ea3cb tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-6f328c21-0078-4190-903a-e27ade927896-delete_snapshot" released by "delete_snapshot" :: held 3.008s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:21:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-312da4e5-ad64-413d-9aa3-57940286dc8a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "cinder-e863021c-97a5-48e9-a905-15e15f6fb8a1-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:21:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-312da4e5-ad64-413d-9aa3-57940286dc8a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-e863021c-97a5-48e9-a905-15e15f6fb8a1-delete_volume" acquired by "delete_volume" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:21:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-312da4e5-ad64-413d-9aa3-57940286dc8a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "cinder-quobyte-e863021c-97a5-48e9-a905-15e15f6fb8a1" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:21:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-312da4e5-ad64-413d-9aa3-57940286dc8a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-quobyte-e863021c-97a5-48e9-a905-15e15f6fb8a1" acquired by "delete_volume" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:21:51 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[50b1d6d8-8bed-4b13-b081-847fee658d38]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:21:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-312da4e5-ad64-413d-9aa3-57940286dc8a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:51 devstack sudo[105673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1 Jul 09 10:21:51 devstack sudo[105673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:51 devstack sudo[105673]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-312da4e5-ad64-413d-9aa3-57940286dc8a tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1" returned: 0 in 0.712s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-312da4e5-ad64-413d-9aa3-57940286dc8a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:51 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1 Jul 09 10:21:51 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:52 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-312da4e5-ad64-413d-9aa3-57940286dc8a tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e863021c-97a5-48e9-a905-15e15f6fb8a1" returned: 0 in 0.625s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-312da4e5-ad64-413d-9aa3-57940286dc8a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-quobyte-e863021c-97a5-48e9-a905-15e15f6fb8a1" released by "delete_volume" :: held 1.392s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:21:52 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-312da4e5-ad64-413d-9aa3-57940286dc8a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Created reservations ['5eb5134a-1c09-4dbc-a802-e769ae647404', 'fe295c82-927d-486d-b3a8-eb86e265f0e2', '87c9f829-3a55-4aba-b3f0-109b0c350911', '71741a94-570a-461e-9d4d-ae1dbb92d6fe'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:21:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-312da4e5-ad64-413d-9aa3-57940286dc8a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-312da4e5-ad64-413d-9aa3-57940286dc8a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-312da4e5-ad64-413d-9aa3-57940286dc8a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:21:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-312da4e5-ad64-413d-9aa3-57940286dc8a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:21:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-312da4e5-ad64-413d-9aa3-57940286dc8a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-312da4e5-ad64-413d-9aa3-57940286dc8a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:52 devstack sudo[105681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:21:52 devstack sudo[105681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:53 devstack sudo[105681]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-312da4e5-ad64-413d-9aa3-57940286dc8a tempest-CreateVolumesFromSnapshotTest-1898369248 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.627s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:53 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-312da4e5-ad64-413d-9aa3-57940286dc8a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:21:53 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-312da4e5-ad64-413d-9aa3-57940286dc8a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Deleted volume successfully. Jul 09 10:21:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-312da4e5-ad64-413d-9aa3-57940286dc8a tempest-CreateVolumesFromSnapshotTest-1898369248 None] Lock "cinder-e863021c-97a5-48e9-a905-15e15f6fb8a1-delete_volume" released by "delete_volume" :: held 2.192s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Flow 'volume_create_manager' (a06d7670-2732-47ed-b7a5-559eee776509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f59c221-8cee-431b-b8d9-836877bfc68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f59c221-8cee-431b-b8d9-836877bfc68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8df0748-c070-4a11-b66a-7292753754ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8580ab288a7f4bd68cf96681ddb99024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:21:56Z,use_quota=True,user_id='3a382218e81947abb85f24f721971771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2755e9-eb5f-4a77-b1ba-548c28a277a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e2755e9-eb5f-4a77-b1ba-548c28a277a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5b47af-8cb4-4557-8864-0226f6240293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c5b47af-8cb4-4557-8864-0226f6240293) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8df0748-c070-4a11-b66a-7292753754ed', 'volume_name': 'volume-c8df0748-c070-4a11-b66a-7292753754ed', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af847248-db0a-4aee-9c90-ed711f6e112b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af847248-db0a-4aee-9c90-ed711f6e112b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972cae1b-2e3d-42aa-ae62-9044cfb73ec1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:55 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Volume c8df0748-c070-4a11-b66a-7292753754ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8df0748-c070-4a11-b66a-7292753754ed', 'volume_size': 1} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:21:55Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8df0748-c070-4a11-b66a-7292753754ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8580ab288a7f4bd68cf96681ddb99024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:21:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:21:56Z,use_quota=True,user_id='3a382218e81947abb85f24f721971771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Creating volume c8df0748-c070-4a11-b66a-7292753754ed {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:21:55 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:21:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c8df0748-c070-4a11-b66a-7292753754ed 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:55 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c8df0748-c070-4a11-b66a-7292753754ed 1073741824 Jul 09 10:21:55 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:56 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c8df0748-c070-4a11-b66a-7292753754ed 1073741824" returned: 0 in 0.765s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c8df0748-c070-4a11-b66a-7292753754ed {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:56 devstack sudo[105691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c8df0748-c070-4a11-b66a-7292753754ed Jul 09 10:21:56 devstack sudo[105691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:57 devstack sudo[105691]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c8df0748-c070-4a11-b66a-7292753754ed" returned: 0 in 0.618s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] <== create_volume: return (1419ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:21:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.422s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (972cae1b-2e3d-42aa-ae62-9044cfb73ec1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8df0748-c070-4a11-b66a-7292753754ed', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d8cf7d-157b-43a6-943a-9d7333668ced) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Volume volume-c8df0748-c070-4a11-b66a-7292753754ed (c8df0748-c070-4a11-b66a-7292753754ed): created successfully Jul 09 10:21:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7d8cf7d-157b-43a6-943a-9d7333668ced) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Flow 'volume_create_manager' (a06d7670-2732-47ed-b7a5-559eee776509) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:21:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-126bb45f-971b-4e9f-b82f-4f568c3cca66 tempest-CinderUnicodeTest-1013587798 None] Created volume successfully. Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Flow 'volume_create_manager' (52003206-05a4-4f09-9383-1b1b192ff93a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b3e709-cb65-40a5-bb87-ecd33f8b99f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17b3e709-cb65-40a5-bb87-ecd33f8b99f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:21:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-237952610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3741ff05-ba11-45bb-84d9-0eac64e2f6a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8580ab288a7f4bd68cf96681ddb99024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:21:58Z,use_quota=True,user_id='3a382218e81947abb85f24f721971771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc061e18-83c7-4245-b235-fc1f2285e515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc061e18-83c7-4245-b235-fc1f2285e515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (334dded1-f16a-49c6-829a-95bade0c597f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (334dded1-f16a-49c6-829a-95bade0c597f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3741ff05-ba11-45bb-84d9-0eac64e2f6a3', 'volume_name': 'volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2fbe34-3ed9-4a90-8236-999014b5c5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a2fbe34-3ed9-4a90-8236-999014b5c5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b751559-8d49-49d4-8d01-903bf4101273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:58 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Volume 3741ff05-ba11-45bb-84d9-0eac64e2f6a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3', 'volume_size': 1} Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:21:58Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-237952610',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3741ff05-ba11-45bb-84d9-0eac64e2f6a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8580ab288a7f4bd68cf96681ddb99024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:21:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:21:58Z,use_quota=True,user_id='3a382218e81947abb85f24f721971771',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Creating volume 3741ff05-ba11-45bb-84d9-0eac64e2f6a3 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:21:58 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:21:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:58 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3 1073741824 Jul 09 10:21:58 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:59 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3 1073741824" returned: 0 in 0.784s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:21:59 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3 Jul 09 10:21:59 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:21:59 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Jul 09 10:21:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3" returned: 0 in 0.618s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:21:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] <== create_volume: return (1440ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:21:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.443s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:21:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5b751559-8d49-49d4-8d01-903bf4101273) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df38d93-4a20-4171-82a3-3cffdd10af5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:21:59 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Volume volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3 (3741ff05-ba11-45bb-84d9-0eac64e2f6a3): created successfully Jul 09 10:21:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1df38d93-4a20-4171-82a3-3cffdd10af5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:21:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Flow 'volume_create_manager' (52003206-05a4-4f09-9383-1b1b192ff93a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:21:59 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c484b96c-c402-4052-a214-c8be9aa8c6d6 tempest-CinderUnicodeTest-1013587798 None] Created volume successfully. Jul 09 10:22:00 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=61,cinder:INSERT=21,cinder:UPDATE=87,cinder:DELETE=9 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:22:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-395c325f-1993-4e13-917f-a4405368872f tempest-CinderUnicodeTest-1013587798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-395c325f-1993-4e13-917f-a4405368872f tempest-CinderUnicodeTest-1013587798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-395c325f-1993-4e13-917f-a4405368872f tempest-CinderUnicodeTest-1013587798 None] Creating offline snapshot 1e2230af-df7c-409f-aa6b-28e81496b612 of volume 3741ff05-ba11-45bb-84d9-0eac64e2f6a3 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:22:00 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ffe46ad-c2fb-41d7-9f77-2a22ed88946f]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-395c325f-1993-4e13-917f-a4405368872f tempest-CinderUnicodeTest-1013587798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:00 devstack sudo[105703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3 Jul 09 10:22:00 devstack sudo[105703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:01 devstack sudo[105703]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-395c325f-1993-4e13-917f-a4405368872f tempest-CinderUnicodeTest-1013587798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3" returned: 0 in 0.765s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-395c325f-1993-4e13-917f-a4405368872f tempest-CinderUnicodeTest-1013587798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.1e2230af-df7c-409f-aa6b-28e81496b612 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:01 devstack sudo[105708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.1e2230af-df7c-409f-aa6b-28e81496b612 1G Jul 09 10:22:01 devstack sudo[105708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:02 devstack sudo[105708]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-395c325f-1993-4e13-917f-a4405368872f tempest-CinderUnicodeTest-1013587798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.1e2230af-df7c-409f-aa6b-28e81496b612 1G" returned: 0 in 0.779s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-395c325f-1993-4e13-917f-a4405368872f tempest-CinderUnicodeTest-1013587798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.1e2230af-df7c-409f-aa6b-28e81496b612 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:02 devstack sudo[105714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.1e2230af-df7c-409f-aa6b-28e81496b612 Jul 09 10:22:02 devstack sudo[105714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:02 devstack sudo[105714]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-395c325f-1993-4e13-917f-a4405368872f tempest-CinderUnicodeTest-1013587798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.1e2230af-df7c-409f-aa6b-28e81496b612" returned: 0 in 0.674s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:02 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-395c325f-1993-4e13-917f-a4405368872f tempest-CinderUnicodeTest-1013587798 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.1e2230af-df7c-409f-aa6b-28e81496b612 is being set with open permissions: ugo+rw Jul 09 10:22:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-395c325f-1993-4e13-917f-a4405368872f tempest-CinderUnicodeTest-1013587798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.1e2230af-df7c-409f-aa6b-28e81496b612 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:02 devstack sudo[105719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.1e2230af-df7c-409f-aa6b-28e81496b612 Jul 09 10:22:02 devstack sudo[105719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:03 devstack sudo[105719]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-395c325f-1993-4e13-917f-a4405368872f tempest-CinderUnicodeTest-1013587798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.1e2230af-df7c-409f-aa6b-28e81496b612" returned: 0 in 0.621s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-395c325f-1993-4e13-917f-a4405368872f tempest-CinderUnicodeTest-1013587798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:03 devstack sudo[105722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.info Jul 09 10:22:03 devstack sudo[105722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:04 devstack sudo[105722]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-395c325f-1993-4e13-917f-a4405368872f tempest-CinderUnicodeTest-1013587798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.info" returned: 0 in 0.639s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:04 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-395c325f-1993-4e13-917f-a4405368872f tempest-CinderUnicodeTest-1013587798 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.info is being set with open permissions: ugo+rw Jul 09 10:22:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-395c325f-1993-4e13-917f-a4405368872f tempest-CinderUnicodeTest-1013587798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:04 devstack sudo[105725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.info Jul 09 10:22:04 devstack sudo[105725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:04 devstack sudo[105725]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-395c325f-1993-4e13-917f-a4405368872f tempest-CinderUnicodeTest-1013587798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.info" returned: 0 in 0.637s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-395c325f-1993-4e13-917f-a4405368872f tempest-CinderUnicodeTest-1013587798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.198s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-395c325f-1993-4e13-917f-a4405368872f tempest-CinderUnicodeTest-1013587798 None] Create snapshot completed successfully Jul 09 10:22:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] Acquiring lock "cinder-1e2230af-df7c-409f-aa6b-28e81496b612-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] Lock "cinder-1e2230af-df7c-409f-aa6b-28e81496b612-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] Acquiring lock "cinder-quobyte-3741ff05-ba11-45bb-84d9-0eac64e2f6a3" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] Lock "cinder-quobyte-3741ff05-ba11-45bb-84d9-0eac64e2f6a3" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] Acquiring lock "cinder-quobyte-1e2230af-df7c-409f-aa6b-28e81496b612" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] Lock "cinder-quobyte-1e2230af-df7c-409f-aa6b-28e81496b612" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] Deleting offline snapshot 1e2230af-df7c-409f-aa6b-28e81496b612 of volume 3741ff05-ba11-45bb-84d9-0eac64e2f6a3 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:22:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] snapshot_file for this snap is: volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.1e2230af-df7c-409f-aa6b-28e81496b612 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:22:05 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a78a145c-b951-40de-ac24-fe88351e0c42]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.1e2230af-df7c-409f-aa6b-28e81496b612 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:05 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.1e2230af-df7c-409f-aa6b-28e81496b612 Jul 09 10:22:05 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:06 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.1e2230af-df7c-409f-aa6b-28e81496b612" returned: 0 in 0.753s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:22:06 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[cfe96a5a-74b9-47ce-bace-5cfbcabecd5e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:06 devstack sudo[105735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3 Jul 09 10:22:06 devstack sudo[105735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:07 devstack sudo[105735]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3" returned: 0 in 0.748s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.1e2230af-df7c-409f-aa6b-28e81496b612 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:07 devstack sudo[105740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.1e2230af-df7c-409f-aa6b-28e81496b612 Jul 09 10:22:07 devstack sudo[105740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:08 devstack sudo[105740]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.1e2230af-df7c-409f-aa6b-28e81496b612" returned: 0 in 0.702s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.1e2230af-df7c-409f-aa6b-28e81496b612 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:08 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.1e2230af-df7c-409f-aa6b-28e81496b612 Jul 09 10:22:08 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:08 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3.1e2230af-df7c-409f-aa6b-28e81496b612" returned: 0 in 0.616s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] Lock "cinder-quobyte-1e2230af-df7c-409f-aa6b-28e81496b612" released by "_delete_snapshot" :: held 2.914s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:22:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] Lock "cinder-quobyte-3741ff05-ba11-45bb-84d9-0eac64e2f6a3" released by "delete_snapshot" :: held 2.937s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:22:08 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] Created reservations ['f6d90822-02d2-4cf3-8b32-9bc525b0c456', 'b9f80dce-32ff-4ca2-8412-a1ac2d133c42', 'fae7f9bc-0142-4598-b783-9563b12b72f7', '5773781b-cd71-4fe7-8726-aab81f9da13b'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:22:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] Delete snapshot completed successfully. Jul 09 10:22:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-01de8e8c-b9bc-4655-8e16-a02a3e25daf1 tempest-CinderUnicodeTest-1013587798 None] Lock "cinder-1e2230af-df7c-409f-aa6b-28e81496b612-delete_snapshot" released by "delete_snapshot" :: held 3.059s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:22:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6107dedf-bf97-470f-9a8e-55ba03280cc8 tempest-CinderUnicodeTest-1013587798 None] Acquiring lock "cinder-3741ff05-ba11-45bb-84d9-0eac64e2f6a3-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6107dedf-bf97-470f-9a8e-55ba03280cc8 tempest-CinderUnicodeTest-1013587798 None] Lock "cinder-3741ff05-ba11-45bb-84d9-0eac64e2f6a3-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6107dedf-bf97-470f-9a8e-55ba03280cc8 tempest-CinderUnicodeTest-1013587798 None] Acquiring lock "cinder-quobyte-3741ff05-ba11-45bb-84d9-0eac64e2f6a3" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6107dedf-bf97-470f-9a8e-55ba03280cc8 tempest-CinderUnicodeTest-1013587798 None] Lock "cinder-quobyte-3741ff05-ba11-45bb-84d9-0eac64e2f6a3" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:09 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80c72cb-fee0-4f55-8396-05b60ecff2f0]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6107dedf-bf97-470f-9a8e-55ba03280cc8 tempest-CinderUnicodeTest-1013587798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:09 devstack sudo[105749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3 Jul 09 10:22:09 devstack sudo[105749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:09 devstack sudo[105749]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6107dedf-bf97-470f-9a8e-55ba03280cc8 tempest-CinderUnicodeTest-1013587798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3" returned: 0 in 0.741s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6107dedf-bf97-470f-9a8e-55ba03280cc8 tempest-CinderUnicodeTest-1013587798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:09 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3 Jul 09 10:22:09 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:10 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6107dedf-bf97-470f-9a8e-55ba03280cc8 tempest-CinderUnicodeTest-1013587798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3741ff05-ba11-45bb-84d9-0eac64e2f6a3" returned: 0 in 0.621s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6107dedf-bf97-470f-9a8e-55ba03280cc8 tempest-CinderUnicodeTest-1013587798 None] Lock "cinder-quobyte-3741ff05-ba11-45bb-84d9-0eac64e2f6a3" released by "delete_volume" :: held 1.415s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:22:10 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-6107dedf-bf97-470f-9a8e-55ba03280cc8 tempest-CinderUnicodeTest-1013587798 None] Created reservations ['5a5a0479-1ee7-4ba6-89fc-189239e3c94b', '34e87f8f-eea9-4844-9941-ac7607006920', '9d32016a-f214-4e7f-a558-7290bcda07d5', '5b7acdaf-3f6c-4176-92dd-3b7d3a0a0af0'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:22:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6107dedf-bf97-470f-9a8e-55ba03280cc8 tempest-CinderUnicodeTest-1013587798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6107dedf-bf97-470f-9a8e-55ba03280cc8 tempest-CinderUnicodeTest-1013587798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6107dedf-bf97-470f-9a8e-55ba03280cc8 tempest-CinderUnicodeTest-1013587798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6107dedf-bf97-470f-9a8e-55ba03280cc8 tempest-CinderUnicodeTest-1013587798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6107dedf-bf97-470f-9a8e-55ba03280cc8 tempest-CinderUnicodeTest-1013587798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6107dedf-bf97-470f-9a8e-55ba03280cc8 tempest-CinderUnicodeTest-1013587798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:10 devstack sudo[105757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:22:10 devstack sudo[105757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9fd82f7e-680f-40ca-b6a3-c9a24f7b3338 tempest-CinderUnicodeTest-1013587798 None] Acquiring lock "cinder-c8df0748-c070-4a11-b66a-7292753754ed-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:11 devstack sudo[105757]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6107dedf-bf97-470f-9a8e-55ba03280cc8 tempest-CinderUnicodeTest-1013587798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.651s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:11 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-6107dedf-bf97-470f-9a8e-55ba03280cc8 tempest-CinderUnicodeTest-1013587798 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:22:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9fd82f7e-680f-40ca-b6a3-c9a24f7b3338 tempest-CinderUnicodeTest-1013587798 None] Lock "cinder-c8df0748-c070-4a11-b66a-7292753754ed-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:11 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6107dedf-bf97-470f-9a8e-55ba03280cc8 tempest-CinderUnicodeTest-1013587798 None] Deleted volume successfully. Jul 09 10:22:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6107dedf-bf97-470f-9a8e-55ba03280cc8 tempest-CinderUnicodeTest-1013587798 None] Lock "cinder-3741ff05-ba11-45bb-84d9-0eac64e2f6a3-delete_volume" released by "delete_volume" :: held 2.266s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:22:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9fd82f7e-680f-40ca-b6a3-c9a24f7b3338 tempest-CinderUnicodeTest-1013587798 None] Acquiring lock "cinder-quobyte-c8df0748-c070-4a11-b66a-7292753754ed" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:11 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9fd82f7e-680f-40ca-b6a3-c9a24f7b3338 tempest-CinderUnicodeTest-1013587798 None] Lock "cinder-quobyte-c8df0748-c070-4a11-b66a-7292753754ed" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:11 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b950d371-a3ef-41d9-b8dd-c4c4652f2c2c]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9fd82f7e-680f-40ca-b6a3-c9a24f7b3338 tempest-CinderUnicodeTest-1013587798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c8df0748-c070-4a11-b66a-7292753754ed {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:11 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c8df0748-c070-4a11-b66a-7292753754ed Jul 09 10:22:11 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:12 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9fd82f7e-680f-40ca-b6a3-c9a24f7b3338 tempest-CinderUnicodeTest-1013587798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c8df0748-c070-4a11-b66a-7292753754ed" returned: 0 in 0.728s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9fd82f7e-680f-40ca-b6a3-c9a24f7b3338 tempest-CinderUnicodeTest-1013587798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c8df0748-c070-4a11-b66a-7292753754ed {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:12 devstack sudo[105765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c8df0748-c070-4a11-b66a-7292753754ed Jul 09 10:22:12 devstack sudo[105765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:12 devstack sudo[105765]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9fd82f7e-680f-40ca-b6a3-c9a24f7b3338 tempest-CinderUnicodeTest-1013587798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c8df0748-c070-4a11-b66a-7292753754ed" returned: 0 in 0.617s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9fd82f7e-680f-40ca-b6a3-c9a24f7b3338 tempest-CinderUnicodeTest-1013587798 None] Lock "cinder-quobyte-c8df0748-c070-4a11-b66a-7292753754ed" released by "delete_volume" :: held 1.388s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:22:12 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-9fd82f7e-680f-40ca-b6a3-c9a24f7b3338 tempest-CinderUnicodeTest-1013587798 None] Created reservations ['d6419b45-50ad-401a-87d5-16cf551f61fc', '0b19ccfe-d3fa-4c69-9f2c-c95b5c92e1ca', '76232f0c-9316-48a9-a64c-fb0b8b92f8a6', 'd4128197-1112-4df6-9bb9-2869023b338c'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:22:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9fd82f7e-680f-40ca-b6a3-c9a24f7b3338 tempest-CinderUnicodeTest-1013587798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9fd82f7e-680f-40ca-b6a3-c9a24f7b3338 tempest-CinderUnicodeTest-1013587798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9fd82f7e-680f-40ca-b6a3-c9a24f7b3338 tempest-CinderUnicodeTest-1013587798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9fd82f7e-680f-40ca-b6a3-c9a24f7b3338 tempest-CinderUnicodeTest-1013587798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9fd82f7e-680f-40ca-b6a3-c9a24f7b3338 tempest-CinderUnicodeTest-1013587798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9fd82f7e-680f-40ca-b6a3-c9a24f7b3338 tempest-CinderUnicodeTest-1013587798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:12 devstack sudo[105768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:22:12 devstack sudo[105768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:13 devstack sudo[105768]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9fd82f7e-680f-40ca-b6a3-c9a24f7b3338 tempest-CinderUnicodeTest-1013587798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.622s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:13 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-9fd82f7e-680f-40ca-b6a3-c9a24f7b3338 tempest-CinderUnicodeTest-1013587798 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:22:13 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9fd82f7e-680f-40ca-b6a3-c9a24f7b3338 tempest-CinderUnicodeTest-1013587798 None] Deleted volume successfully. Jul 09 10:22:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9fd82f7e-680f-40ca-b6a3-c9a24f7b3338 tempest-CinderUnicodeTest-1013587798 None] Lock "cinder-c8df0748-c070-4a11-b66a-7292753754ed-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:22:22 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=72,cinder:UPDATE=99,cinder:DELETE=9,cinder:INSERT=25 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:22:23 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=20,cinder:UPDATE=24,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Flow 'volume_create_manager' (49bf00bd-c6cd-47cd-8c5a-41b18891045c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ee2132-82fe-4b65-80e2-dfa2a3dfbcc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6ee2132-82fe-4b65-80e2-dfa2a3dfbcc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1208388631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b206e25-f563-44a7-9ebf-56a42a482c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468c5f8901a3402f90e8d400b746c183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:25Z,use_quota=True,user_id='705d609448654f32a817274be7c9d2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d8dfda-5a76-470b-90e3-46ecefbf1b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23d8dfda-5a76-470b-90e3-46ecefbf1b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f87cbc-3f73-433a-ada7-7731aadd85f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72f87cbc-3f73-433a-ada7-7731aadd85f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b206e25-f563-44a7-9ebf-56a42a482c58', 'volume_name': 'volume-4b206e25-f563-44a7-9ebf-56a42a482c58', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1277d0f7-f69a-4faf-90c5-b6bd5dcb3c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1277d0f7-f69a-4faf-90c5-b6bd5dcb3c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b48fec74-2616-440f-9eee-a10635f16255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:24 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Volume 4b206e25-f563-44a7-9ebf-56a42a482c58: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b206e25-f563-44a7-9ebf-56a42a482c58', 'volume_size': 1} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1208388631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b206e25-f563-44a7-9ebf-56a42a482c58,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468c5f8901a3402f90e8d400b746c183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:25Z,use_quota=True,user_id='705d609448654f32a817274be7c9d2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Creating volume 4b206e25-f563-44a7-9ebf-56a42a482c58 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:22:24 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4b206e25-f563-44a7-9ebf-56a42a482c58 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:24 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4b206e25-f563-44a7-9ebf-56a42a482c58 1073741824 Jul 09 10:22:24 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:24 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Flow 'volume_create_manager' (0ebd415a-ea1a-4f7c-9d41-d706f587ba70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ccb1f1-f88d-4858-bc28-52f5d829de23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91ccb1f1-f88d-4858-bc28-52f5d829de23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-381329540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c01db1c8-9e03-4376-9738-f6abdf3f101b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3aa2268ac414c699af0f9d8a25318c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:25Z,use_quota=True,user_id='9d85f912a933470fab5a317e92257ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b417eb2a-0a66-4ea8-9889-21639d2be1f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b417eb2a-0a66-4ea8-9889-21639d2be1f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151d18cf-ec37-4706-8609-35aa918c5ab1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (151d18cf-ec37-4706-8609-35aa918c5ab1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c01db1c8-9e03-4376-9738-f6abdf3f101b', 'volume_name': 'volume-c01db1c8-9e03-4376-9738-f6abdf3f101b', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de976cf-3aec-4977-8897-815717a3f9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5de976cf-3aec-4977-8897-815717a3f9bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1702a8-9a7d-4528-bd73-b3b66a33574d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:25 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Volume c01db1c8-9e03-4376-9738-f6abdf3f101b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c01db1c8-9e03-4376-9738-f6abdf3f101b', 'volume_size': 1} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Flow 'volume_create_manager' (6e778389-b45e-471e-b64f-3ee58bea33b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f61df5-17a2-4127-9241-4c5867e28230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8f61df5-17a2-4127-9241-4c5867e28230) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-698970033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e36cb43-573c-4f9f-b9d9-8cae684e9c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468c5f8901a3402f90e8d400b746c183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:25Z,use_quota=True,user_id='705d609448654f32a817274be7c9d2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e67c54-dd40-4899-8566-9daa855abd14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36e67c54-dd40-4899-8566-9daa855abd14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a16a104-b9bd-4b60-8caf-ccae0022cb99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6a16a104-b9bd-4b60-8caf-ccae0022cb99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e36cb43-573c-4f9f-b9d9-8cae684e9c68', 'volume_name': 'volume-3e36cb43-573c-4f9f-b9d9-8cae684e9c68', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088ed8f7-7797-458b-961b-482d7e25d30a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (088ed8f7-7797-458b-961b-482d7e25d30a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0a157e-6cda-4da2-9fac-44a4254ac57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:25 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Volume 3e36cb43-573c-4f9f-b9d9-8cae684e9c68: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e36cb43-573c-4f9f-b9d9-8cae684e9c68', 'volume_size': 1} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Flow 'volume_create_manager' (a7392c4b-2657-47e0-b673-354231956b70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bfe9bc-2ae7-4119-ac2a-0c6297a42036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73bfe9bc-2ae7-4119-ac2a-0c6297a42036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1159866909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35aba3fec084c38837fb775de2f0580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:25Z,use_quota=True,user_id='2c0e429982804f3f9721b8e869715773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6eb31c4-2e05-4736-9603-39413e5ee9dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d6eb31c4-2e05-4736-9603-39413e5ee9dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956dfb44-25da-4cac-a488-4a71dcae2650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956dfb44-25da-4cac-a488-4a71dcae2650) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1', 'volume_name': 'volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a335abef-effd-4951-9cc0-39e3011b868b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a335abef-effd-4951-9cc0-39e3011b868b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c1a02a-7676-4a26-915a-a5972e38a812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:25 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Volume 1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1', 'volume_size': 1} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Flow 'volume_create_manager' (080440f6-c9b5-47cc-b358-c509b7452f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b067b7-15c9-4d32-8108-b25938aafe3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6b067b7-15c9-4d32-8108-b25938aafe3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-877404181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd683b63-07b1-4840-8dcc-ac8caef46b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468c5f8901a3402f90e8d400b746c183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:26Z,use_quota=True,user_id='705d609448654f32a817274be7c9d2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:26 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbc17de-365d-40e3-84ff-27787fdab5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fbc17de-365d-40e3-84ff-27787fdab5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af63104e-72fa-4da9-b8a5-86600a90d36e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af63104e-72fa-4da9-b8a5-86600a90d36e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cd683b63-07b1-4840-8dcc-ac8caef46b54', 'volume_name': 'volume-cd683b63-07b1-4840-8dcc-ac8caef46b54', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f17cd3-3c02-466c-9157-c2463959f183) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f17cd3-3c02-466c-9157-c2463959f183) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf57d4a-a4ec-4a74-a28a-38357119934d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:26 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Volume cd683b63-07b1-4840-8dcc-ac8caef46b54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cd683b63-07b1-4840-8dcc-ac8caef46b54', 'volume_size': 1} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4b206e25-f563-44a7-9ebf-56a42a482c58 1073741824" returned: 0 in 1.146s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4b206e25-f563-44a7-9ebf-56a42a482c58 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:26 devstack sudo[105815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4b206e25-f563-44a7-9ebf-56a42a482c58 Jul 09 10:22:26 devstack sudo[105815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Flow 'volume_create_manager' (2e987386-a17c-4c0d-a217-f9a26bf82593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3067405f-f1c1-416a-889c-36fef35f9837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3067405f-f1c1-416a-889c-36fef35f9837) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-594943890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78dab2e-c44d-48ad-b698-0c6754346676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468c5f8901a3402f90e8d400b746c183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:26Z,use_quota=True,user_id='705d609448654f32a817274be7c9d2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b373ba-4e97-4829-aae6-37981eae2bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76b373ba-4e97-4829-aae6-37981eae2bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5975710c-57b7-43b5-afce-b38e0e16fd1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5975710c-57b7-43b5-afce-b38e0e16fd1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b78dab2e-c44d-48ad-b698-0c6754346676', 'volume_name': 'volume-b78dab2e-c44d-48ad-b698-0c6754346676', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c24ccd-f3df-4261-a086-354850ab6e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33c24ccd-f3df-4261-a086-354850ab6e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8c9882-7200-4638-9522-a599a222dc3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:26 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Volume b78dab2e-c44d-48ad-b698-0c6754346676: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b78dab2e-c44d-48ad-b698-0c6754346676', 'volume_size': 1} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Flow 'volume_create_manager' (ba53a782-ac72-4170-b2aa-e77527b8f698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850fa27a-a5c6-4384-80df-620eb79177d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (850fa27a-a5c6-4384-80df-620eb79177d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-791641896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf2aefc-8a95-4ac5-a07d-95cf7ab4c011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468c5f8901a3402f90e8d400b746c183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:27Z,use_quota=True,user_id='705d609448654f32a817274be7c9d2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98097f18-1aef-4728-b190-d5b0669cba55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98097f18-1aef-4728-b190-d5b0669cba55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ddf735-8527-4046-8770-064313d6278f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ddf735-8527-4046-8770-064313d6278f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faf2aefc-8a95-4ac5-a07d-95cf7ab4c011', 'volume_name': 'volume-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88eb35a-7176-47e1-a452-17b87005ba3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88eb35a-7176-47e1-a452-17b87005ba3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee52a42-2af3-4ed9-a592-99ceb98bee57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:26 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Volume faf2aefc-8a95-4ac5-a07d-95cf7ab4c011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011', 'volume_size': 1} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:26 devstack sudo[105815]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4b206e25-f563-44a7-9ebf-56a42a482c58" returned: 0 in 0.790s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] <== create_volume: return (1994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.996s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.833s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-381329540',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c01db1c8-9e03-4376-9738-f6abdf3f101b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3aa2268ac414c699af0f9d8a25318c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:25Z,use_quota=True,user_id='9d85f912a933470fab5a317e92257ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Creating volume c01db1c8-9e03-4376-9738-f6abdf3f101b {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:22:26 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b48fec74-2616-440f-9eee-a10635f16255) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b206e25-f563-44a7-9ebf-56a42a482c58', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:26 devstack sudo[105818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b 1073741824 Jul 09 10:22:26 devstack sudo[105818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f6281c-1190-439f-a922-90195f02d789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:26 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Volume volume-4b206e25-f563-44a7-9ebf-56a42a482c58 (4b206e25-f563-44a7-9ebf-56a42a482c58): created successfully Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f6281c-1190-439f-a922-90195f02d789) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:26 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Flow 'volume_create_manager' (49bf00bd-c6cd-47cd-8c5a-41b18891045c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:26 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-26d44fb6-2d45-43b1-abbf-e8657e87fe47 tempest-CreateVolumesFromImageTest-1279944827 None] Created volume successfully. Jul 09 10:22:27 devstack sudo[105818]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b 1073741824" returned: 0 in 0.893s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:27 devstack sudo[105823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b Jul 09 10:22:27 devstack sudo[105823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:28 devstack sudo[105823]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b" returned: 0 in 0.680s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.621s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.957s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-698970033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e36cb43-573c-4f9f-b9d9-8cae684e9c68,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468c5f8901a3402f90e8d400b746c183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:25Z,use_quota=True,user_id='705d609448654f32a817274be7c9d2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Creating volume 3e36cb43-573c-4f9f-b9d9-8cae684e9c68 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:22:28 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3e36cb43-573c-4f9f-b9d9-8cae684e9c68 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b1702a8-9a7d-4528-bd73-b3b66a33574d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c01db1c8-9e03-4376-9738-f6abdf3f101b', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e262405-532e-4992-9b13-811b49f81e2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:28 devstack sudo[105827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3e36cb43-573c-4f9f-b9d9-8cae684e9c68 1073741824 Jul 09 10:22:28 devstack sudo[105827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:28 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Volume volume-c01db1c8-9e03-4376-9738-f6abdf3f101b (c01db1c8-9e03-4376-9738-f6abdf3f101b): created successfully Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e262405-532e-4992-9b13-811b49f81e2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Flow 'volume_create_manager' (0ebd415a-ea1a-4f7c-9d41-d706f587ba70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:28 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-709ba4df-3fd9-4cb0-a2d4-969cd842b56a tempest-CreateVolumesFromSnapshotTest-600177175 None] Created volume successfully. Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Flow 'volume_create_manager' (d935fdbd-4c2b-4ff2-afd4-255aff745728) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (425ef3d4-d737-472a-8e8c-c17dd567cfd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (425ef3d4-d737-472a-8e8c-c17dd567cfd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e079ef2a-66d1-4995-9c84-c9494d9848ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bd90ee852b438ea83b95dcc8bc9383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:29Z,use_quota=True,user_id='75eda5690e624c778a02ed13f318e7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c69dc684-858d-47b4-b498-1a675b6b48b5),volume_type_id=c69dc684-858d-47b4-b498-1a675b6b48b5)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971dfd21-a264-4a4a-ae76-b9c0a1462274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (971dfd21-a264-4a4a-ae76-b9c0a1462274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956a22c4-e94e-4c79-9e91-c79ca111c0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:28 devstack cinder-volume[87192]: DEBUG cinder.image.glance [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Creating Keystone auth plugin from conf {{(pid=87192) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 10:22:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (956a22c4-e94e-4c79-9e91-c79ca111c0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e079ef2a-66d1-4995-9c84-c9494d9848ec', 'volume_name': 'volume-e079ef2a-66d1-4995-9c84-c9494d9848ec', 'volume_size': 1, 'image_id': 'ee8bd563-577f-49f1-844f-9a919ff94add', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee8bd563-577f-49f1-844f-9a919ff94add', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '28102d567b2ba31e181cbca52fdfd909', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd5bd90ee852b438ea83b95dcc8bc9383', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c71b3813c3c5051614c8961f5a891615e3370a6badb51635231b98dbf1806d206095b3a5098a8a3fb336ef00eb0f1414cd59600cac340c8bd70ae7d8678f37a', 'id': 'ee8bd563-577f-49f1-844f-9a919ff94add', 'created_at': datetime.datetime(2026, 7, 9, 8, 22, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 8, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee8bd563-577f-49f1-844f-9a919ff94add/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (747b5986-264b-4403-804e-5f352e832c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (747b5986-264b-4403-804e-5f352e832c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31e6fb8-0447-4972-9465-c6c8c66695a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:29 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Volume e079ef2a-66d1-4995-9c84-c9494d9848ec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e079ef2a-66d1-4995-9c84-c9494d9848ec', 'volume_size': 1, 'image_id': 'ee8bd563-577f-49f1-844f-9a919ff94add', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee8bd563-577f-49f1-844f-9a919ff94add', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '28102d567b2ba31e181cbca52fdfd909', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd5bd90ee852b438ea83b95dcc8bc9383', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c71b3813c3c5051614c8961f5a891615e3370a6badb51635231b98dbf1806d206095b3a5098a8a3fb336ef00eb0f1414cd59600cac340c8bd70ae7d8678f37a', 'id': 'ee8bd563-577f-49f1-844f-9a919ff94add', 'created_at': datetime.datetime(2026, 7, 9, 8, 22, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 8, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee8bd563-577f-49f1-844f-9a919ff94add/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 09 10:22:29 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Trying to clone e079ef2a-66d1-4995-9c84-c9494d9848ec from image ee8bd563-577f-49f1-844f-9a919ff94add at location (None, [{'url': 'file:///opt/stack/data/glance/images/ee8bd563-577f-49f1-844f-9a919ff94add', 'metadata': {}}]). {{(pid=87192) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 10:22:29 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 10:22:29 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Image download 0.00 MB at 0.00 MB/s Jul 09 10:22:29 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f81db277-7ed2-4c0e-a9d5-d868582a1e86]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:29 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD Jul 09 10:22:29 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:29 devstack sudo[105827]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3e36cb43-573c-4f9f-b9d9-8cae684e9c68 1073741824" returned: 0 in 0.885s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3e36cb43-573c-4f9f-b9d9-8cae684e9c68 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:29 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3e36cb43-573c-4f9f-b9d9-8cae684e9c68 Jul 09 10:22:29 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e67bfc1d-3f1a-4053-b0bc-583193fda4af tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:22:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:29 devstack sudo[105836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:22:29 devstack sudo[105836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:29 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD" returned: 0 in 0.739s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:30 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD Jul 09 10:22:30 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:30 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3e36cb43-573c-4f9f-b9d9-8cae684e9c68" returned: 0 in 0.771s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.555s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1159866909',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35aba3fec084c38837fb775de2f0580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:25Z,use_quota=True,user_id='2c0e429982804f3f9721b8e869715773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Creating volume 1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:22:30 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c0a157e-6cda-4da2-9fac-44a4254ac57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e36cb43-573c-4f9f-b9d9-8cae684e9c68', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:30 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 1073741824 Jul 09 10:22:30 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6cb296-02b1-4882-b1c9-588c80ae2f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:30 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Volume volume-3e36cb43-573c-4f9f-b9d9-8cae684e9c68 (3e36cb43-573c-4f9f-b9d9-8cae684e9c68): created successfully Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae6cb296-02b1-4882-b1c9-588c80ae2f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Flow 'volume_create_manager' (6e778389-b45e-471e-b64f-3ee58bea33b4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-cdfb34e8-1fd1-419d-9389-4df96070c36e tempest-CreateVolumesFromImageTest-1279944827 None] Created volume successfully. Jul 09 10:22:30 devstack sudo[105836]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.692s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:22:30 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD" returned: 1 in 0.725s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Temporary image ee8bd563-577f-49f1-844f-9a919ff94add is fetched for user 75eda5690e624c778a02ed13f318e7be. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9f11138-ce0e-427b-9011-8de5090f283b]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:30 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD Jul 09 10:22:30 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:31 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 1073741824" returned: 0 in 0.907s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:31 devstack sudo[105855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 Jul 09 10:22:31 devstack sudo[105855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:31 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD" returned: 0 in 0.774s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:31 devstack sudo[105859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD Jul 09 10:22:31 devstack sudo[105859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:31 devstack sudo[105855]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1" returned: 0 in 0.649s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] <== create_volume: return (1598ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.602s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.784s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-877404181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cd683b63-07b1-4840-8dcc-ac8caef46b54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468c5f8901a3402f90e8d400b746c183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:26Z,use_quota=True,user_id='705d609448654f32a817274be7c9d2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Creating volume cd683b63-07b1-4840-8dcc-ac8caef46b54 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:22:31 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cd683b63-07b1-4840-8dcc-ac8caef46b54 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:31 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cd683b63-07b1-4840-8dcc-ac8caef46b54 1073741824 Jul 09 10:22:31 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c1a02a-7676-4a26-915a-a5972e38a812) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0340c9fc-af0c-4d10-ba6b-0b57b27acf83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:31 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Volume volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 (1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1): created successfully Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0340c9fc-af0c-4d10-ba6b-0b57b27acf83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Flow 'volume_create_manager' (a7392c4b-2657-47e0-b673-354231956b70) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:31 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6c8c9074-9964-4d18-82a3-a5e137716eb3 tempest-VolumeDependencyTests-2079059416 None] Created volume successfully. Jul 09 10:22:32 devstack sudo[105859]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD" returned: 1 in 0.725s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:22:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:32 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cd683b63-07b1-4840-8dcc-ac8caef46b54 1073741824" returned: 0 in 0.816s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cd683b63-07b1-4840-8dcc-ac8caef46b54 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:32 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cd683b63-07b1-4840-8dcc-ac8caef46b54 Jul 09 10:22:32 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c6fb6108-c9ad-4d16-8b55-5ce4a82ae22f tempest-VolumeDependencyTests-2079059416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:33 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cd683b63-07b1-4840-8dcc-ac8caef46b54" returned: 0 in 0.654s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:22:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.508s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.766s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-594943890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b78dab2e-c44d-48ad-b698-0c6754346676,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468c5f8901a3402f90e8d400b746c183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:26Z,use_quota=True,user_id='705d609448654f32a817274be7c9d2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:22:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Creating volume b78dab2e-c44d-48ad-b698-0c6754346676 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:22:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:22:33 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:22:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b78dab2e-c44d-48ad-b698-0c6754346676 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbf57d4a-a4ec-4a74-a28a-38357119934d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cd683b63-07b1-4840-8dcc-ac8caef46b54', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3764d2-0a2f-4731-88e2-e9eebc0e931d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:33 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b78dab2e-c44d-48ad-b698-0c6754346676 1073741824 Jul 09 10:22:33 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:33 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Volume volume-cd683b63-07b1-4840-8dcc-ac8caef46b54 (cd683b63-07b1-4840-8dcc-ac8caef46b54): created successfully Jul 09 10:22:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a3764d2-0a2f-4731-88e2-e9eebc0e931d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Flow 'volume_create_manager' (080440f6-c9b5-47cc-b358-c509b7452f88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ecbd3e96-e54a-4343-9e1d-5486b62f31f8 tempest-CreateVolumesFromImageTest-1279944827 None] Created volume successfully. Jul 09 10:22:34 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b78dab2e-c44d-48ad-b698-0c6754346676 1073741824" returned: 0 in 0.829s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b78dab2e-c44d-48ad-b698-0c6754346676 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:34 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b78dab2e-c44d-48ad-b698-0c6754346676 Jul 09 10:22:34 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:34 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b78dab2e-c44d-48ad-b698-0c6754346676" returned: 0 in 0.655s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:22:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.051s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-791641896',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faf2aefc-8a95-4ac5-a07d-95cf7ab4c011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='468c5f8901a3402f90e8d400b746c183',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:27Z,use_quota=True,user_id='705d609448654f32a817274be7c9d2d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:22:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Creating volume faf2aefc-8a95-4ac5-a07d-95cf7ab4c011 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:22:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:22:34 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:22:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf8c9882-7200-4638-9522-a599a222dc3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b78dab2e-c44d-48ad-b698-0c6754346676', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:34 devstack sudo[105882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011 1073741824 Jul 09 10:22:34 devstack sudo[105882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd38f73-71c9-417b-a560-aa1965cebdc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:34 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Volume volume-b78dab2e-c44d-48ad-b698-0c6754346676 (b78dab2e-c44d-48ad-b698-0c6754346676): created successfully Jul 09 10:22:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fd38f73-71c9-417b-a560-aa1965cebdc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:34 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Flow 'volume_create_manager' (2e987386-a17c-4c0d-a217-f9a26bf82593) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:34 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-69f0c57d-3d7a-4840-8e18-6af9d73a8295 tempest-CreateVolumesFromImageTest-1279944827 None] Created volume successfully. Jul 09 10:22:35 devstack sudo[105882]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011 1073741824" returned: 0 in 0.817s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:35 devstack sudo[105923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011 Jul 09 10:22:35 devstack sudo[105923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:36 devstack sudo[105923]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011" returned: 0 in 0.649s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:22:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.516s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e67bfc1d-3f1a-4053-b0bc-583193fda4af tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.639s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ee52a42-2af3-4ed9-a592-99ceb98bee57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96a2f9d-7a2c-401e-b5d2-66521d191921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e67bfc1d-3f1a-4053-b0bc-583193fda4af tempest-CreateVolumesFromSnapshotTest-600177175 None] Creating offline snapshot 02fb9655-2eba-4431-9763-3169f003eba3 of volume c01db1c8-9e03-4376-9738-f6abdf3f101b {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:22:36 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Volume volume-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011 (faf2aefc-8a95-4ac5-a07d-95cf7ab4c011): created successfully Jul 09 10:22:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e96a2f9d-7a2c-401e-b5d2-66521d191921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Flow 'volume_create_manager' (ba53a782-ac72-4170-b2aa-e77527b8f698) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:36 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9455eb-bef9-467a-b0cd-b201e17ef352]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67bfc1d-3f1a-4053-b0bc-583193fda4af tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:36 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-cc00dd11-d148-4daa-ae96-808b47cf70c3 tempest-CreateVolumesFromImageTest-1279944827 None] Created volume successfully. Jul 09 10:22:36 devstack sudo[105926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b Jul 09 10:22:36 devstack sudo[105926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:37 devstack sudo[105926]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67bfc1d-3f1a-4053-b0bc-583193fda4af tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b" returned: 0 in 0.720s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67bfc1d-3f1a-4053-b0bc-583193fda4af tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.02fb9655-2eba-4431-9763-3169f003eba3 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:37 devstack sudo[105931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.02fb9655-2eba-4431-9763-3169f003eba3 1G Jul 09 10:22:37 devstack sudo[105931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f411403d-85a3-4063-856d-42da78d29458 tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "cinder-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f411403d-85a3-4063-856d-42da78d29458 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "cinder-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f411403d-85a3-4063-856d-42da78d29458 tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "cinder-quobyte-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f411403d-85a3-4063-856d-42da78d29458 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "cinder-quobyte-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011" acquired by "delete_volume" :: waited 0.011s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:37 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1de14e2b-2622-4270-b1cf-932fc39d6e9f]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f411403d-85a3-4063-856d-42da78d29458 tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:37 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011 Jul 09 10:22:37 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:37 devstack sudo[105931]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67bfc1d-3f1a-4053-b0bc-583193fda4af tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.02fb9655-2eba-4431-9763-3169f003eba3 1G" returned: 0 in 0.765s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67bfc1d-3f1a-4053-b0bc-583193fda4af tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c01db1c8-9e03-4376-9738-f6abdf3f101b -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.02fb9655-2eba-4431-9763-3169f003eba3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:37 devstack sudo[105939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c01db1c8-9e03-4376-9738-f6abdf3f101b -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.02fb9655-2eba-4431-9763-3169f003eba3 Jul 09 10:22:37 devstack sudo[105939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:38 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f411403d-85a3-4063-856d-42da78d29458 tempest-CreateVolumesFromImageTest-1279944827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011" returned: 0 in 0.738s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f411403d-85a3-4063-856d-42da78d29458 tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:38 devstack sudo[105945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011 Jul 09 10:22:38 devstack sudo[105945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:38 devstack sudo[105939]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67bfc1d-3f1a-4053-b0bc-583193fda4af tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c01db1c8-9e03-4376-9738-f6abdf3f101b -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.02fb9655-2eba-4431-9763-3169f003eba3" returned: 0 in 0.673s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:38 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-e67bfc1d-3f1a-4053-b0bc-583193fda4af tempest-CreateVolumesFromSnapshotTest-600177175 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.02fb9655-2eba-4431-9763-3169f003eba3 is being set with open permissions: ugo+rw Jul 09 10:22:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67bfc1d-3f1a-4053-b0bc-583193fda4af tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.02fb9655-2eba-4431-9763-3169f003eba3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:38 devstack sudo[105950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.02fb9655-2eba-4431-9763-3169f003eba3 Jul 09 10:22:38 devstack sudo[105950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:39 devstack sudo[105945]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f411403d-85a3-4063-856d-42da78d29458 tempest-CreateVolumesFromImageTest-1279944827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011" returned: 0 in 0.631s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f411403d-85a3-4063-856d-42da78d29458 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "cinder-quobyte-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011" released by "delete_volume" :: held 1.422s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:22:39 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-f411403d-85a3-4063-856d-42da78d29458 tempest-CreateVolumesFromImageTest-1279944827 None] Created reservations ['b4eed171-0eb8-4aed-a2a8-9a0f706fc049', 'c4314ae2-08c2-488b-8dba-443e68e39c83', '3d428185-db3f-45f0-b340-b05b7e581966', '083f22f9-82a3-409f-a9e1-a211edb5d397'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:22:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f411403d-85a3-4063-856d-42da78d29458 tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f411403d-85a3-4063-856d-42da78d29458 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f411403d-85a3-4063-856d-42da78d29458 tempest-CreateVolumesFromImageTest-1279944827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f411403d-85a3-4063-856d-42da78d29458 tempest-CreateVolumesFromImageTest-1279944827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f411403d-85a3-4063-856d-42da78d29458 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f411403d-85a3-4063-856d-42da78d29458 tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:39 devstack sudo[105954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:22:39 devstack sudo[105954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:39 devstack sudo[105950]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67bfc1d-3f1a-4053-b0bc-583193fda4af tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.02fb9655-2eba-4431-9763-3169f003eba3" returned: 0 in 0.629s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67bfc1d-3f1a-4053-b0bc-583193fda4af tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:39 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.info Jul 09 10:22:39 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-48edba17-86a5-4d28-84c5-f8fccb54dbc7 tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "cinder-b78dab2e-c44d-48ad-b698-0c6754346676-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-48edba17-86a5-4d28-84c5-f8fccb54dbc7 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "cinder-b78dab2e-c44d-48ad-b698-0c6754346676-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:39 devstack sudo[105954]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f411403d-85a3-4063-856d-42da78d29458 tempest-CreateVolumesFromImageTest-1279944827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.668s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:39 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-f411403d-85a3-4063-856d-42da78d29458 tempest-CreateVolumesFromImageTest-1279944827 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:22:39 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f411403d-85a3-4063-856d-42da78d29458 tempest-CreateVolumesFromImageTest-1279944827 None] Deleted volume successfully. Jul 09 10:22:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-f411403d-85a3-4063-856d-42da78d29458 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "cinder-faf2aefc-8a95-4ac5-a07d-95cf7ab4c011-delete_volume" released by "delete_volume" :: held 2.307s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:22:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-48edba17-86a5-4d28-84c5-f8fccb54dbc7 tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "cinder-quobyte-b78dab2e-c44d-48ad-b698-0c6754346676" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-48edba17-86a5-4d28-84c5-f8fccb54dbc7 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "cinder-quobyte-b78dab2e-c44d-48ad-b698-0c6754346676" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:39 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38dfc6c-941f-48db-9eec-49986e58b2b4]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-48edba17-86a5-4d28-84c5-f8fccb54dbc7 tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b78dab2e-c44d-48ad-b698-0c6754346676 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:40 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67bfc1d-3f1a-4053-b0bc-583193fda4af tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.info" returned: 0 in 0.722s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:40 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-e67bfc1d-3f1a-4053-b0bc-583193fda4af tempest-CreateVolumesFromSnapshotTest-600177175 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.info is being set with open permissions: ugo+rw Jul 09 10:22:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67bfc1d-3f1a-4053-b0bc-583193fda4af tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:40 devstack sudo[105961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.info Jul 09 10:22:40 devstack sudo[105961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:40 devstack sudo[105960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b78dab2e-c44d-48ad-b698-0c6754346676 Jul 09 10:22:40 devstack sudo[105960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:40 devstack sudo[105961]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e67bfc1d-3f1a-4053-b0bc-583193fda4af tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.info" returned: 0 in 0.640s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e67bfc1d-3f1a-4053-b0bc-583193fda4af tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.271s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.440s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e079ef2a-66d1-4995-9c84-c9494d9848ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5bd90ee852b438ea83b95dcc8bc9383',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:29Z,use_quota=True,user_id='75eda5690e624c778a02ed13f318e7be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c69dc684-858d-47b4-b498-1a675b6b48b5),volume_type_id=c69dc684-858d-47b4-b498-1a675b6b48b5)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:22:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Creating volume e079ef2a-66d1-4995-9c84-c9494d9848ec {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:22:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:22:40 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:22:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:40 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec 1073741824 Jul 09 10:22:40 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:40 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e67bfc1d-3f1a-4053-b0bc-583193fda4af tempest-CreateVolumesFromSnapshotTest-600177175 None] Create snapshot completed successfully Jul 09 10:22:40 devstack sudo[105960]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-48edba17-86a5-4d28-84c5-f8fccb54dbc7 tempest-CreateVolumesFromImageTest-1279944827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b78dab2e-c44d-48ad-b698-0c6754346676" returned: 0 in 0.821s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-48edba17-86a5-4d28-84c5-f8fccb54dbc7 tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b78dab2e-c44d-48ad-b698-0c6754346676 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:40 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b78dab2e-c44d-48ad-b698-0c6754346676 Jul 09 10:22:40 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:41 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-48edba17-86a5-4d28-84c5-f8fccb54dbc7 tempest-CreateVolumesFromImageTest-1279944827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-b78dab2e-c44d-48ad-b698-0c6754346676" returned: 0 in 0.732s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-48edba17-86a5-4d28-84c5-f8fccb54dbc7 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "cinder-quobyte-b78dab2e-c44d-48ad-b698-0c6754346676" released by "delete_volume" :: held 1.599s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-48edba17-86a5-4d28-84c5-f8fccb54dbc7 tempest-CreateVolumesFromImageTest-1279944827 None] Created reservations ['d5b2941f-a4f4-4edb-bd70-8b2753917242', '1661618e-1d4d-4776-a32b-112f888ea75a', 'e1a3fe93-f6b7-4279-83fe-a65bf7c9e69d', '3ac95227-276c-46d6-a211-9c6423c7dcad'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:22:41 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec 1073741824" returned: 0 in 0.947s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-48edba17-86a5-4d28-84c5-f8fccb54dbc7 tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-48edba17-86a5-4d28-84c5-f8fccb54dbc7 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-48edba17-86a5-4d28-84c5-f8fccb54dbc7 tempest-CreateVolumesFromImageTest-1279944827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-48edba17-86a5-4d28-84c5-f8fccb54dbc7 tempest-CreateVolumesFromImageTest-1279944827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-48edba17-86a5-4d28-84c5-f8fccb54dbc7 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-48edba17-86a5-4d28-84c5-f8fccb54dbc7 tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:41 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:22:41 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:22:41 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec Jul 09 10:22:41 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Flow 'volume_create_manager' (24097608-f70b-42fa-a333-c974d48c7b65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f0045c-c380-4647-9563-92d616726c58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50f0045c-c380-4647-9563-92d616726c58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2013078754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7bf5782-41bd-4af5-a690-b123ce7e9c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3aa2268ac414c699af0f9d8a25318c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:42Z,use_quota=True,user_id='9d85f912a933470fab5a317e92257ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fedb7ec4-859b-425c-bfdc-5da32d590028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fedb7ec4-859b-425c-bfdc-5da32d590028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a62414-2c9f-4b35-82a3-f12bcb423e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33a62414-2c9f-4b35-82a3-f12bcb423e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7bf5782-41bd-4af5-a690-b123ce7e9c70', 'volume_name': 'volume-c7bf5782-41bd-4af5-a690-b123ce7e9c70', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d3e3fe8-380e-4df2-9845-f34d64fd05bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d3e3fe8-380e-4df2-9845-f34d64fd05bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9e0b7c-cb48-4d29-b5e7-d1d5d099e3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:41 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Volume c7bf5782-41bd-4af5-a690-b123ce7e9c70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7bf5782-41bd-4af5-a690-b123ce7e9c70', 'volume_size': 1} Jul 09 10:22:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2e51f4d4-98b3-4743-9ea5-7606e6ce56ae tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "cinder-cd683b63-07b1-4840-8dcc-ac8caef46b54-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Flow 'volume_create_manager' (a0c572f0-7cf7-4ee9-ab81-b5d3b90bd8cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26889f89-8243-4223-98cd-8aa21d80cdbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26889f89-8243-4223-98cd-8aa21d80cdbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1257511552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abebef2d-ff3e-410a-9341-795bb6549bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3aa2268ac414c699af0f9d8a25318c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:42Z,use_quota=True,user_id='9d85f912a933470fab5a317e92257ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (050c63e8-21e8-4d58-a13e-ad8ed3de0bba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (050c63e8-21e8-4d58-a13e-ad8ed3de0bba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e5e443-9f28-4214-b5a8-103521b6a5f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42e5e443-9f28-4214-b5a8-103521b6a5f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'abebef2d-ff3e-410a-9341-795bb6549bdf', 'volume_name': 'volume-abebef2d-ff3e-410a-9341-795bb6549bdf', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c118e93-fe36-4adb-9db0-3bbc417d7e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c118e93-fe36-4adb-9db0-3bbc417d7e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286aecca-d7cd-4c3f-b49e-b44bb5fe20b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:42 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Volume abebef2d-ff3e-410a-9341-795bb6549bdf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-abebef2d-ff3e-410a-9341-795bb6549bdf', 'volume_size': 1} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2e51f4d4-98b3-4743-9ea5-7606e6ce56ae tempest-CreateVolumesFromImageTest-1279944827 None] Lock "cinder-cd683b63-07b1-4840-8dcc-ac8caef46b54-delete_volume" acquired by "delete_volume" :: waited 0.151s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2e51f4d4-98b3-4743-9ea5-7606e6ce56ae tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "cinder-quobyte-cd683b63-07b1-4840-8dcc-ac8caef46b54" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2e51f4d4-98b3-4743-9ea5-7606e6ce56ae tempest-CreateVolumesFromImageTest-1279944827 None] Lock "cinder-quobyte-cd683b63-07b1-4840-8dcc-ac8caef46b54" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec29195-a89e-41ae-85c4-0419c1ec517a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2e51f4d4-98b3-4743-9ea5-7606e6ce56ae tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cd683b63-07b1-4840-8dcc-ac8caef46b54 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:42 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-48edba17-86a5-4d28-84c5-f8fccb54dbc7 tempest-CreateVolumesFromImageTest-1279944827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.001s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-48edba17-86a5-4d28-84c5-f8fccb54dbc7 tempest-CreateVolumesFromImageTest-1279944827 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:22:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-48edba17-86a5-4d28-84c5-f8fccb54dbc7 tempest-CreateVolumesFromImageTest-1279944827 None] Deleted volume successfully. Jul 09 10:22:42 devstack sudo[105980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cd683b63-07b1-4840-8dcc-ac8caef46b54 Jul 09 10:22:42 devstack sudo[105980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-48edba17-86a5-4d28-84c5-f8fccb54dbc7 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "cinder-b78dab2e-c44d-48ad-b698-0c6754346676-delete_volume" released by "delete_volume" :: held 2.873s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:22:42 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec" returned: 0 in 1.019s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] <== create_volume: return (2057ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.060s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c6fb6108-c9ad-4d16-8b55-5ce4a82ae22f tempest-VolumeDependencyTests-2079059416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.513s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c6fb6108-c9ad-4d16-8b55-5ce4a82ae22f tempest-VolumeDependencyTests-2079059416 None] Creating offline snapshot b39e7efc-df7e-4e55-a535-5a68467c2e00 of volume 1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Flow 'volume_create_manager' (27783f0b-264b-49ba-a25d-e1db6ba191cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc987fbc-2933-4792-922a-cd1aa6967cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3306d9d3-b472-4578-8a79-b6923c8c107d]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6fb6108-c9ad-4d16-8b55-5ce4a82ae22f tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Attempting download of ee8bd563-577f-49f1-844f-9a919ff94add ((None, [{'url': 'file:///opt/stack/data/glance/images/ee8bd563-577f-49f1-844f-9a919ff94add', 'metadata': {}}])) to volume e079ef2a-66d1-4995-9c84-c9494d9848ec. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc987fbc-2933-4792-922a-cd1aa6967cc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-25734717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5accd6-4fed-4283-8e21-fe1e3e5474aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3aa2268ac414c699af0f9d8a25318c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:43Z,use_quota=True,user_id='9d85f912a933470fab5a317e92257ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f875f3-3795-458b-82c8-493e3cf14408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66f875f3-3795-458b-82c8-493e3cf14408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf2b141-5638-4136-bf74-0df36527b7e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebf2b141-5638-4136-bf74-0df36527b7e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc5accd6-4fed-4283-8e21-fe1e3e5474aa', 'volume_name': 'volume-cc5accd6-4fed-4283-8e21-fe1e3e5474aa', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58940a5e-5f73-4510-8597-78838b12a8e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58940a5e-5f73-4510-8597-78838b12a8e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5384e8-3970-4658-9012-b624f0e711de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:42 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Volume cc5accd6-4fed-4283-8e21-fe1e3e5474aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc5accd6-4fed-4283-8e21-fe1e3e5474aa', 'volume_size': 1} Jul 09 10:22:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:43 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 Jul 09 10:22:43 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[514c38aa-4a7f-48b6-bf5b-87f8a90d3374]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee8bd563-577f-49f1-844f-9a919ff94add_utjp0coh {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:22:43 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee8bd563-577f-49f1-844f-9a919ff94add_utjp0coh Jul 09 10:22:43 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Flow 'volume_create_manager' (c733bb90-32a3-435f-968e-e7a8da3114f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b23a56-fecd-4d5d-96fa-559904f8587a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3b23a56-fecd-4d5d-96fa-559904f8587a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1484434672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c7d952-dae6-4081-adb5-4dd76c07fa33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3aa2268ac414c699af0f9d8a25318c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:43Z,use_quota=True,user_id='9d85f912a933470fab5a317e92257ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece939bb-6869-4e7a-aaf2-c6608036ff7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ece939bb-6869-4e7a-aaf2-c6608036ff7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46eb5a58-f513-4061-972f-ac45a3268cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46eb5a58-f513-4061-972f-ac45a3268cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61c7d952-dae6-4081-adb5-4dd76c07fa33', 'volume_name': 'volume-61c7d952-dae6-4081-adb5-4dd76c07fa33', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed6afd4-8346-48f3-ae05-da23349e4ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed6afd4-8346-48f3-ae05-da23349e4ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72071230-466c-42e9-b2ad-9e894c07e1ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:43 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Volume 61c7d952-dae6-4081-adb5-4dd76c07fa33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61c7d952-dae6-4081-adb5-4dd76c07fa33', 'volume_size': 1} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:22:43 devstack sudo[105980]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Flow 'volume_create_manager' (35e1dadb-d851-4ebc-bc87-2491a13b9311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb5e388-9b92-4fe7-8cf5-4e39def06488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2e51f4d4-98b3-4743-9ea5-7606e6ce56ae tempest-CreateVolumesFromImageTest-1279944827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cd683b63-07b1-4840-8dcc-ac8caef46b54" returned: 0 in 1.262s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2e51f4d4-98b3-4743-9ea5-7606e6ce56ae tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cd683b63-07b1-4840-8dcc-ac8caef46b54 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cb5e388-9b92-4fe7-8cf5-4e39def06488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-731876534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c990ddad-77ae-41e1-9378-f4feae10087e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3aa2268ac414c699af0f9d8a25318c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:44Z,use_quota=True,user_id='9d85f912a933470fab5a317e92257ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8a6b0c-c827-40e6-9e7a-3ee293477866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:43 devstack sudo[105997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cd683b63-07b1-4840-8dcc-ac8caef46b54 Jul 09 10:22:43 devstack sudo[105997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fd8a6b0c-c827-40e6-9e7a-3ee293477866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f14a3b-bab2-4af6-8c0b-019702e0e6b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29f14a3b-bab2-4af6-8c0b-019702e0e6b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c990ddad-77ae-41e1-9378-f4feae10087e', 'volume_name': 'volume-c990ddad-77ae-41e1-9378-f4feae10087e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c60f1fb-8445-4d7d-b220-c8cb640155d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c60f1fb-8445-4d7d-b220-c8cb640155d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94670e45-cb5e-4398-b601-3c3017027447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:43 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Volume c990ddad-77ae-41e1-9378-f4feae10087e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c990ddad-77ae-41e1-9378-f4feae10087e', 'volume_size': 1} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:43 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6fb6108-c9ad-4d16-8b55-5ce4a82ae22f tempest-VolumeDependencyTests-2079059416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1" returned: 0 in 1.036s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6fb6108-c9ad-4d16-8b55-5ce4a82ae22f tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:43 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_ee8bd563-577f-49f1-844f-9a919ff94add_utjp0coh" returned: 0 in 0.890s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:43 devstack sudo[106004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00 1G Jul 09 10:22:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee8bd563-577f-49f1-844f-9a919ff94add_utjp0coh {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:43 devstack sudo[106004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:44 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee8bd563-577f-49f1-844f-9a919ff94add_utjp0coh Jul 09 10:22:44 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:44 devstack sudo[105997]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2e51f4d4-98b3-4743-9ea5-7606e6ce56ae tempest-CreateVolumesFromImageTest-1279944827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cd683b63-07b1-4840-8dcc-ac8caef46b54" returned: 0 in 0.692s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2e51f4d4-98b3-4743-9ea5-7606e6ce56ae tempest-CreateVolumesFromImageTest-1279944827 None] Lock "cinder-quobyte-cd683b63-07b1-4840-8dcc-ac8caef46b54" released by "delete_volume" :: held 2.032s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:22:44 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-2e51f4d4-98b3-4743-9ea5-7606e6ce56ae tempest-CreateVolumesFromImageTest-1279944827 None] Created reservations ['9cf6fdd1-a7f8-4404-ab3a-95a88401990e', '39598a30-8419-4483-a950-5ca8bb2e4d1a', '44eb8ca5-7843-4b10-8645-61aec2037d85', '18834589-93cc-4cd9-98d8-0c6e6edb96cc'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:22:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2e51f4d4-98b3-4743-9ea5-7606e6ce56ae tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2e51f4d4-98b3-4743-9ea5-7606e6ce56ae tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2e51f4d4-98b3-4743-9ea5-7606e6ce56ae tempest-CreateVolumesFromImageTest-1279944827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-2e51f4d4-98b3-4743-9ea5-7606e6ce56ae tempest-CreateVolumesFromImageTest-1279944827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2e51f4d4-98b3-4743-9ea5-7606e6ce56ae tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2e51f4d4-98b3-4743-9ea5-7606e6ce56ae tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:44 devstack sudo[106013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:22:44 devstack sudo[106013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:44 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee8bd563-577f-49f1-844f-9a919ff94add_utjp0coh" returned: 1 in 0.837s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_ee8bd563-577f-49f1-844f-9a919ff94add_utjp0coh' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:22:44 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[59d1322f-8324-419d-b48b-bc1a824d1063]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:44 devstack sudo[106004]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6fb6108-c9ad-4d16-8b55-5ce4a82ae22f tempest-VolumeDependencyTests-2079059416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00 1G" returned: 0 in 0.928s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6fb6108-c9ad-4d16-8b55-5ce4a82ae22f tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:44 devstack sudo[106019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00 Jul 09 10:22:44 devstack sudo[106019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:44 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD Jul 09 10:22:44 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:45 devstack sudo[106013]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2e51f4d4-98b3-4743-9ea5-7606e6ce56ae tempest-CreateVolumesFromImageTest-1279944827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.719s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:45 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-2e51f4d4-98b3-4743-9ea5-7606e6ce56ae tempest-CreateVolumesFromImageTest-1279944827 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:22:45 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2e51f4d4-98b3-4743-9ea5-7606e6ce56ae tempest-CreateVolumesFromImageTest-1279944827 None] Deleted volume successfully. Jul 09 10:22:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-2e51f4d4-98b3-4743-9ea5-7606e6ce56ae tempest-CreateVolumesFromImageTest-1279944827 None] Lock "cinder-cd683b63-07b1-4840-8dcc-ac8caef46b54-delete_volume" released by "delete_volume" :: held 3.016s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:22:45 devstack sudo[106019]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6fb6108-c9ad-4d16-8b55-5ce4a82ae22f tempest-VolumeDependencyTests-2079059416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00" returned: 0 in 0.667s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:45 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-c6fb6108-c9ad-4d16-8b55-5ce4a82ae22f tempest-VolumeDependencyTests-2079059416 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00 is being set with open permissions: ugo+rw Jul 09 10:22:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6fb6108-c9ad-4d16-8b55-5ce4a82ae22f tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:45 devstack sudo[106028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00 Jul 09 10:22:45 devstack sudo[106028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:45 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD" returned: 0 in 0.767s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-03f60af8-a195-4bc3-9eaa-c174ba879923 tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "cinder-3e36cb43-573c-4f9f-b9d9-8cae684e9c68-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-03f60af8-a195-4bc3-9eaa-c174ba879923 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "cinder-3e36cb43-573c-4f9f-b9d9-8cae684e9c68-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-03f60af8-a195-4bc3-9eaa-c174ba879923 tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "cinder-quobyte-3e36cb43-573c-4f9f-b9d9-8cae684e9c68" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-03f60af8-a195-4bc3-9eaa-c174ba879923 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "cinder-quobyte-3e36cb43-573c-4f9f-b9d9-8cae684e9c68" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:45 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD Jul 09 10:22:45 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:45 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc761c4-526f-4c12-ae64-b8476db8da42]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03f60af8-a195-4bc3-9eaa-c174ba879923 tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3e36cb43-573c-4f9f-b9d9-8cae684e9c68 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:45 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3e36cb43-573c-4f9f-b9d9-8cae684e9c68 Jul 09 10:22:45 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:46 devstack sudo[106028]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6fb6108-c9ad-4d16-8b55-5ce4a82ae22f tempest-VolumeDependencyTests-2079059416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00" returned: 0 in 0.764s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6fb6108-c9ad-4d16-8b55-5ce4a82ae22f tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:46 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.info Jul 09 10:22:46 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:46 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD" returned: 1 in 0.839s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:22:46 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] ee8bd563-577f-49f1-844f-9a919ff94add was raw, converting to raw {{(pid=87192) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 10:22:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:46 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec Jul 09 10:22:46 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:46 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03f60af8-a195-4bc3-9eaa-c174ba879923 tempest-CreateVolumesFromImageTest-1279944827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3e36cb43-573c-4f9f-b9d9-8cae684e9c68" returned: 0 in 0.829s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03f60af8-a195-4bc3-9eaa-c174ba879923 tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3e36cb43-573c-4f9f-b9d9-8cae684e9c68 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:46 devstack sudo[106045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3e36cb43-573c-4f9f-b9d9-8cae684e9c68 Jul 09 10:22:46 devstack sudo[106045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:46 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6fb6108-c9ad-4d16-8b55-5ce4a82ae22f tempest-VolumeDependencyTests-2079059416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.info" returned: 0 in 0.695s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:46 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-c6fb6108-c9ad-4d16-8b55-5ce4a82ae22f tempest-VolumeDependencyTests-2079059416 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.info is being set with open permissions: ugo+rw Jul 09 10:22:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6fb6108-c9ad-4d16-8b55-5ce4a82ae22f tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:47 devstack sudo[106050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.info Jul 09 10:22:47 devstack sudo[106050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:47 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec" returned: 0 in 0.789s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_ee8bd563-577f-49f1-844f-9a919ff94add_d_cjs9m8devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:22:47 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:47 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec 1G Jul 09 10:22:47 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:47 devstack sudo[106045]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03f60af8-a195-4bc3-9eaa-c174ba879923 tempest-CreateVolumesFromImageTest-1279944827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-3e36cb43-573c-4f9f-b9d9-8cae684e9c68" returned: 0 in 0.683s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-03f60af8-a195-4bc3-9eaa-c174ba879923 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "cinder-quobyte-3e36cb43-573c-4f9f-b9d9-8cae684e9c68" released by "delete_volume" :: held 1.570s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-03f60af8-a195-4bc3-9eaa-c174ba879923 tempest-CreateVolumesFromImageTest-1279944827 None] Created reservations ['8e2c8bf6-9b99-45ad-86b5-c3fd78840bec', 'c2306ea2-b145-42da-b59a-bfdf79730abb', 'fc2208e7-74e6-4c07-86fd-875aa5d5d28c', 'ad00409d-f821-4582-b4b5-abe3701b8523'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03f60af8-a195-4bc3-9eaa-c174ba879923 tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03f60af8-a195-4bc3-9eaa-c174ba879923 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03f60af8-a195-4bc3-9eaa-c174ba879923 tempest-CreateVolumesFromImageTest-1279944827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03f60af8-a195-4bc3-9eaa-c174ba879923 tempest-CreateVolumesFromImageTest-1279944827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03f60af8-a195-4bc3-9eaa-c174ba879923 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03f60af8-a195-4bc3-9eaa-c174ba879923 tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:47 devstack sudo[106056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:22:47 devstack sudo[106056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:47 devstack sudo[106050]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c6fb6108-c9ad-4d16-8b55-5ce4a82ae22f tempest-VolumeDependencyTests-2079059416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.info" returned: 0 in 0.684s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c6fb6108-c9ad-4d16-8b55-5ce4a82ae22f tempest-VolumeDependencyTests-2079059416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.922s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.837s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2013078754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7bf5782-41bd-4af5-a690-b123ce7e9c70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3aa2268ac414c699af0f9d8a25318c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:42Z,use_quota=True,user_id='9d85f912a933470fab5a317e92257ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Creating volume c7bf5782-41bd-4af5-a690-b123ce7e9c70 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:22:47 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c7bf5782-41bd-4af5-a690-b123ce7e9c70 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:47 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c7bf5782-41bd-4af5-a690-b123ce7e9c70 1073741824 Jul 09 10:22:47 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c6fb6108-c9ad-4d16-8b55-5ce4a82ae22f tempest-VolumeDependencyTests-2079059416 None] Create snapshot completed successfully Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d5b075c3-127a-42cf-a979-bf22c5bf64c5 tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "cinder-4b206e25-f563-44a7-9ebf-56a42a482c58-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d5b075c3-127a-42cf-a979-bf22c5bf64c5 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "cinder-4b206e25-f563-44a7-9ebf-56a42a482c58-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d5b075c3-127a-42cf-a979-bf22c5bf64c5 tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "cinder-quobyte-4b206e25-f563-44a7-9ebf-56a42a482c58" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d5b075c3-127a-42cf-a979-bf22c5bf64c5 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "cinder-quobyte-4b206e25-f563-44a7-9ebf-56a42a482c58" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:48 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec 1G" returned: 0 in 0.904s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ad4f26f-3488-482f-82bf-ccbfaade9d44]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d5b075c3-127a-42cf-a979-bf22c5bf64c5 tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4b206e25-f563-44a7-9ebf-56a42a482c58 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:48 devstack sudo[106056]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03f60af8-a195-4bc3-9eaa-c174ba879923 tempest-CreateVolumesFromImageTest-1279944827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.724s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-03f60af8-a195-4bc3-9eaa-c174ba879923 tempest-CreateVolumesFromImageTest-1279944827 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:22:48 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-03f60af8-a195-4bc3-9eaa-c174ba879923 tempest-CreateVolumesFromImageTest-1279944827 None] Deleted volume successfully. Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a308ebd-686f-4f9b-ac0c-1fa29f1a55b2]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-03f60af8-a195-4bc3-9eaa-c174ba879923 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "cinder-3e36cb43-573c-4f9f-b9d9-8cae684e9c68-delete_volume" released by "delete_volume" :: held 2.576s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:22:48 devstack sudo[106065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4b206e25-f563-44a7-9ebf-56a42a482c58 Jul 09 10:22:48 devstack sudo[106065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:48 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec Jul 09 10:22:48 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:22:48 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c7bf5782-41bd-4af5-a690-b123ce7e9c70 1073741824" returned: 0 in 1.016s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Flow 'volume_create_manager' (06f486a5-fd17-4422-8589-2f8c0eeafcbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8141f763-05e5-4881-b1d5-468ff4b7501d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8141f763-05e5-4881-b1d5-468ff4b7501d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1713242154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2497c9d4-148d-4e4d-9fb7-75f0225ab34c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d35aba3fec084c38837fb775de2f0580',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b39e7efc-df7e-4e55-a535-5a68467c2e00,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:49Z,use_quota=True,user_id='2c0e429982804f3f9721b8e869715773',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbd6a2a-32a9-44a1-8ce7-5ec8ceae51a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cbd6a2a-32a9-44a1-8ce7-5ec8ceae51a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3140098-d7ac-49ab-84f3-13252e399a60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3140098-d7ac-49ab-84f3-13252e399a60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '2497c9d4-148d-4e4d-9fb7-75f0225ab34c', 'volume_name': 'volume-2497c9d4-148d-4e4d-9fb7-75f0225ab34c', 'volume_size': 1, 'snapshot_id': 'b39e7efc-df7e-4e55-a535-5a68467c2e00'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61db90cc-cfd6-43bc-ac1b-f04471e7c5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (61db90cc-cfd6-43bc-ac1b-f04471e7c5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f730ed-108c-44b9-a20c-63bf802118f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:48 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Volume 2497c9d4-148d-4e4d-9fb7-75f0225ab34c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-2497c9d4-148d-4e4d-9fb7-75f0225ab34c', 'volume_size': 1, 'snapshot_id': 'b39e7efc-df7e-4e55-a535-5a68467c2e00'} Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c7bf5782-41bd-4af5-a690-b123ce7e9c70 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:48 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c7bf5782-41bd-4af5-a690-b123ce7e9c70 Jul 09 10:22:48 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:48 devstack sudo[106065]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d5b075c3-127a-42cf-a979-bf22c5bf64c5 tempest-CreateVolumesFromImageTest-1279944827 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4b206e25-f563-44a7-9ebf-56a42a482c58" returned: 0 in 0.912s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d5b075c3-127a-42cf-a979-bf22c5bf64c5 tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4b206e25-f563-44a7-9ebf-56a42a482c58 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:49 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4b206e25-f563-44a7-9ebf-56a42a482c58 Jul 09 10:22:49 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:49 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec" returned: 0 in 0.973s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:49 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec Jul 09 10:22:49 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:49 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c7bf5782-41bd-4af5-a690-b123ce7e9c70" returned: 0 in 0.666s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] <== create_volume: return (1800ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.804s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.199s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1257511552',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=abebef2d-ff3e-410a-9341-795bb6549bdf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3aa2268ac414c699af0f9d8a25318c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:42Z,use_quota=True,user_id='9d85f912a933470fab5a317e92257ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Creating volume abebef2d-ff3e-410a-9341-795bb6549bdf {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:22:49 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-abebef2d-ff3e-410a-9341-795bb6549bdf 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c9e0b7c-cb48-4d29-b5e7-d1d5d099e3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7bf5782-41bd-4af5-a690-b123ce7e9c70', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:49 devstack sudo[106086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-abebef2d-ff3e-410a-9341-795bb6549bdf 1073741824 Jul 09 10:22:49 devstack sudo[106086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311f8804-fceb-4eb5-a061-06f29d094b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:49 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Volume volume-c7bf5782-41bd-4af5-a690-b123ce7e9c70 (c7bf5782-41bd-4af5-a690-b123ce7e9c70): created successfully Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (311f8804-fceb-4eb5-a061-06f29d094b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Flow 'volume_create_manager' (24097608-f70b-42fa-a333-c974d48c7b65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:49 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-92b2b798-ac35-4643-be0d-3ba9703a5f02 tempest-CreateVolumesFromSnapshotTest-600177175 None] Created volume successfully. Jul 09 10:22:49 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d5b075c3-127a-42cf-a979-bf22c5bf64c5 tempest-CreateVolumesFromImageTest-1279944827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-4b206e25-f563-44a7-9ebf-56a42a482c58" returned: 0 in 0.708s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d5b075c3-127a-42cf-a979-bf22c5bf64c5 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "cinder-quobyte-4b206e25-f563-44a7-9ebf-56a42a482c58" released by "delete_volume" :: held 1.676s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d5b075c3-127a-42cf-a979-bf22c5bf64c5 tempest-CreateVolumesFromImageTest-1279944827 None] Created reservations ['773aa295-47bd-4300-a309-10e416840ebf', '19046857-4dca-43f6-8248-99944fa293a0', '2157fc72-5ca7-4e81-9307-69e5ba1e54af', '9e3bd49e-0427-4886-a274-a82832e654e6'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d5b075c3-127a-42cf-a979-bf22c5bf64c5 tempest-CreateVolumesFromImageTest-1279944827 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d5b075c3-127a-42cf-a979-bf22c5bf64c5 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d5b075c3-127a-42cf-a979-bf22c5bf64c5 tempest-CreateVolumesFromImageTest-1279944827 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d5b075c3-127a-42cf-a979-bf22c5bf64c5 tempest-CreateVolumesFromImageTest-1279944827 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d5b075c3-127a-42cf-a979-bf22c5bf64c5 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d5b075c3-127a-42cf-a979-bf22c5bf64c5 tempest-CreateVolumesFromImageTest-1279944827 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:49 devstack sudo[106092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:22:49 devstack sudo[106092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:49 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec" returned: 1 in 0.808s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Downloaded image ee8bd563-577f-49f1-844f-9a919ff94add ((None, [{'url': 'file:///opt/stack/data/glance/images/ee8bd563-577f-49f1-844f-9a919ff94add', 'metadata': {}}])) to volume e079ef2a-66d1-4995-9c84-c9494d9848ec successfully. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Temporary image ee8bd563-577f-49f1-844f-9a919ff94add for user 75eda5690e624c778a02ed13f318e7be is deleted. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Marking volume e079ef2a-66d1-4995-9c84-c9494d9848ec as bootable. {{(pid=87192) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Copying metadata from image ee8bd563-577f-49f1-844f-9a919ff94add to e079ef2a-66d1-4995-9c84-c9494d9848ec. {{(pid=87192) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Creating volume glance metadata for volume e079ef2a-66d1-4995-9c84-c9494d9848ec backed by image ee8bd563-577f-49f1-844f-9a919ff94add with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'ee8bd563-577f-49f1-844f-9a919ff94add', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '28102d567b2ba31e181cbca52fdfd909', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87192) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 10:22:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d31e6fb8-0447-4972-9465-c6c8c66695a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e079ef2a-66d1-4995-9c84-c9494d9848ec', 'volume_size': 1, 'image_id': 'ee8bd563-577f-49f1-844f-9a919ff94add', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/ee8bd563-577f-49f1-844f-9a919ff94add', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '28102d567b2ba31e181cbca52fdfd909', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'd5bd90ee852b438ea83b95dcc8bc9383', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '2c71b3813c3c5051614c8961f5a891615e3370a6badb51635231b98dbf1806d206095b3a5098a8a3fb336ef00eb0f1414cd59600cac340c8bd70ae7d8678f37a', 'id': 'ee8bd563-577f-49f1-844f-9a919ff94add', 'created_at': datetime.datetime(2026, 7, 9, 8, 22, 26, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 8, 22, 28, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/ee8bd563-577f-49f1-844f-9a919ff94add/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc002a8-6645-4121-9e07-7fa9b4f45abb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:50 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Volume volume-e079ef2a-66d1-4995-9c84-c9494d9848ec (e079ef2a-66d1-4995-9c84-c9494d9848ec): created successfully Jul 09 10:22:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4cc002a8-6645-4121-9e07-7fa9b4f45abb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Flow 'volume_create_manager' (d935fdbd-4c2b-4ff2-afd4-255aff745728) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-af2b26cc-de33-4318-9830-5bbd36ed204e tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Created volume successfully. Jul 09 10:22:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Acquiring lock "cinder-e079ef2a-66d1-4995-9c84-c9494d9848ec-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Lock "cinder-e079ef2a-66d1-4995-9c84-c9494d9848ec-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Acquiring lock "cinder-quobyte-e079ef2a-66d1-4995-9c84-c9494d9848ec" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Lock "cinder-quobyte-e079ef2a-66d1-4995-9c84-c9494d9848ec" acquired by "delete_volume" :: waited 0.020s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:50 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a0bfcc-e7e5-445d-bb96-3e451353c6dc]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:50 devstack sudo[106086]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-abebef2d-ff3e-410a-9341-795bb6549bdf 1073741824" returned: 0 in 1.066s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:50 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec Jul 09 10:22:50 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-abebef2d-ff3e-410a-9341-795bb6549bdf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:50 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-abebef2d-ff3e-410a-9341-795bb6549bdf Jul 09 10:22:50 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:50 devstack sudo[106092]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d5b075c3-127a-42cf-a979-bf22c5bf64c5 tempest-CreateVolumesFromImageTest-1279944827 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.841s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:50 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-d5b075c3-127a-42cf-a979-bf22c5bf64c5 tempest-CreateVolumesFromImageTest-1279944827 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:22:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d5b075c3-127a-42cf-a979-bf22c5bf64c5 tempest-CreateVolumesFromImageTest-1279944827 None] Deleted volume successfully. Jul 09 10:22:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d5b075c3-127a-42cf-a979-bf22c5bf64c5 tempest-CreateVolumesFromImageTest-1279944827 None] Lock "cinder-4b206e25-f563-44a7-9ebf-56a42a482c58-delete_volume" released by "delete_volume" :: held 2.799s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:22:51 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:51 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec" returned: 0 in 0.880s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-abebef2d-ff3e-410a-9341-795bb6549bdf" returned: 0 in 0.734s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] <== create_volume: return (1861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:22:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.864s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.395s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-25734717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc5accd6-4fed-4283-8e21-fe1e3e5474aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3aa2268ac414c699af0f9d8a25318c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:43Z,use_quota=True,user_id='9d85f912a933470fab5a317e92257ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:22:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Creating volume cc5accd6-4fed-4283-8e21-fe1e3e5474aa {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:22:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:22:51 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:22:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cc5accd6-4fed-4283-8e21-fe1e3e5474aa 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (286aecca-d7cd-4c3f-b49e-b44bb5fe20b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-abebef2d-ff3e-410a-9341-795bb6549bdf', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3eafc0-2dc5-45f2-a1de-1eecc304b8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:51 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cc5accd6-4fed-4283-8e21-fe1e3e5474aa 1073741824 Jul 09 10:22:51 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:51 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Volume volume-abebef2d-ff3e-410a-9341-795bb6549bdf (abebef2d-ff3e-410a-9341-795bb6549bdf): created successfully Jul 09 10:22:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec3eafc0-2dc5-45f2-a1de-1eecc304b8c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Flow 'volume_create_manager' (a0c572f0-7cf7-4ee9-ab81-b5d3b90bd8cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:51 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-af032a0d-850b-4479-90a7-c91c6d0645fb tempest-CreateVolumesFromSnapshotTest-600177175 None] Created volume successfully. Jul 09 10:22:51 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec Jul 09 10:22:51 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:52 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec" returned: 1 in 0.840s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:22:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:52 devstack sudo[106117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec Jul 09 10:22:52 devstack sudo[106117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:52 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cc5accd6-4fed-4283-8e21-fe1e3e5474aa 1073741824" returned: 0 in 0.948s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cc5accd6-4fed-4283-8e21-fe1e3e5474aa {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:52 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cc5accd6-4fed-4283-8e21-fe1e3e5474aa Jul 09 10:22:52 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:52 devstack sudo[106117]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-e079ef2a-66d1-4995-9c84-c9494d9848ec" returned: 0 in 0.724s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Lock "cinder-quobyte-e079ef2a-66d1-4995-9c84-c9494d9848ec" released by "delete_volume" :: held 2.518s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:22:52 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Created reservations ['87be31f8-0f3f-443e-bd7a-2f82a0750701', 'bb65e8c9-a070-4739-b629-6bc6e582a154', 'b8c571d4-65b7-403c-88fc-15ddac46470b', '610ba53d-d3bc-488b-9164-d6227d0f69f9'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:53 devstack sudo[106123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:22:53 devstack sudo[106123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:53 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cc5accd6-4fed-4283-8e21-fe1e3e5474aa" returned: 0 in 0.684s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] <== create_volume: return (1750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.752s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.838s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1484434672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61c7d952-dae6-4081-adb5-4dd76c07fa33,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3aa2268ac414c699af0f9d8a25318c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:43Z,use_quota=True,user_id='9d85f912a933470fab5a317e92257ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Creating volume 61c7d952-dae6-4081-adb5-4dd76c07fa33 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:22:53 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-61c7d952-dae6-4081-adb5-4dd76c07fa33 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f5384e8-3970-4658-9012-b624f0e711de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc5accd6-4fed-4283-8e21-fe1e3e5474aa', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:53 devstack sudo[106125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-61c7d952-dae6-4081-adb5-4dd76c07fa33 1073741824 Jul 09 10:22:53 devstack sudo[106125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20869155-0451-4d2c-95b4-5794ce5c077e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:53 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Volume volume-cc5accd6-4fed-4283-8e21-fe1e3e5474aa (cc5accd6-4fed-4283-8e21-fe1e3e5474aa): created successfully Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20869155-0451-4d2c-95b4-5794ce5c077e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Flow 'volume_create_manager' (27783f0b-264b-49ba-a25d-e1db6ba191cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:53 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-66912f5b-dee8-41c8-8e54-3985439a587f tempest-CreateVolumesFromSnapshotTest-600177175 None] Created volume successfully. Jul 09 10:22:53 devstack sudo[106123]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.670s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:22:53 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Deleted volume successfully. Jul 09 10:22:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d631ddf3-881f-43ab-909d-824f1b6c0e8c tempest-VolumeAndVolumeTypeFromImageTest-1983427418 None] Lock "cinder-e079ef2a-66d1-4995-9c84-c9494d9848ec-delete_volume" released by "delete_volume" :: held 3.430s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:22:54 devstack sudo[106125]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-61c7d952-dae6-4081-adb5-4dd76c07fa33 1073741824" returned: 0 in 0.998s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-61c7d952-dae6-4081-adb5-4dd76c07fa33 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:54 devstack sudo[106135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-61c7d952-dae6-4081-adb5-4dd76c07fa33 Jul 09 10:22:54 devstack sudo[106135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:54 devstack sudo[106135]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-61c7d952-dae6-4081-adb5-4dd76c07fa33" returned: 0 in 0.691s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:22:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.117s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:22:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-731876534',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c990ddad-77ae-41e1-9378-f4feae10087e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c3aa2268ac414c699af0f9d8a25318c6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:22:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:22:44Z,use_quota=True,user_id='9d85f912a933470fab5a317e92257ae6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:22:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Creating volume c990ddad-77ae-41e1-9378-f4feae10087e {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:22:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:22:54 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:22:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c990ddad-77ae-41e1-9378-f4feae10087e 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72071230-466c-42e9-b2ad-9e894c07e1ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61c7d952-dae6-4081-adb5-4dd76c07fa33', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40eed1f5-04a2-49d6-8b49-39adefa14da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:54 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c990ddad-77ae-41e1-9378-f4feae10087e 1073741824 Jul 09 10:22:54 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:54 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Volume volume-61c7d952-dae6-4081-adb5-4dd76c07fa33 (61c7d952-dae6-4081-adb5-4dd76c07fa33): created successfully Jul 09 10:22:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40eed1f5-04a2-49d6-8b49-39adefa14da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Flow 'volume_create_manager' (c733bb90-32a3-435f-968e-e7a8da3114f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:54 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b2a53d52-81c8-458c-8cf0-bda84f784761 tempest-CreateVolumesFromSnapshotTest-600177175 None] Created volume successfully. Jul 09 10:22:55 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c990ddad-77ae-41e1-9378-f4feae10087e 1073741824" returned: 0 in 1.044s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c990ddad-77ae-41e1-9378-f4feae10087e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:55 devstack sudo[106145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c990ddad-77ae-41e1-9378-f4feae10087e Jul 09 10:22:56 devstack sudo[106145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:56 devstack sudo[106145]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c990ddad-77ae-41e1-9378-f4feae10087e" returned: 0 in 0.707s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] <== create_volume: return (1807ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.809s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 7.872s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Acquiring lock "cinder-quobyte-b39e7efc-df7e-4e55-a535-5a68467c2e00-2497c9d4-148d-4e4d-9fb7-75f0225ab34c" by "_create_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94670e45-cb5e-4398-b601-3c3017027447) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c990ddad-77ae-41e1-9378-f4feae10087e', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9afb8a-4f19-423f-bde2-1c592ac1f712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Lock "cinder-quobyte-b39e7efc-df7e-4e55-a535-5a68467c2e00-2497c9d4-148d-4e4d-9fb7-75f0225ab34c" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Creating volume 2497c9d4-148d-4e4d-9fb7-75f0225ab34c from snapshot b39e7efc-df7e-4e55-a535-5a68467c2e00 {{(pid=87192) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Acquiring lock "cinder-quobyte-2497c9d4-148d-4e4d-9fb7-75f0225ab34c" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:56 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Volume volume-c990ddad-77ae-41e1-9378-f4feae10087e (c990ddad-77ae-41e1-9378-f4feae10087e): created successfully Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a9afb8a-4f19-423f-bde2-1c592ac1f712) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Flow 'volume_create_manager' (35e1dadb-d851-4ebc-bc87-2491a13b9311) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Lock "cinder-quobyte-2497c9d4-148d-4e4d-9fb7-75f0225ab34c" acquired by "_copy_volume_from_snapshot" :: waited 0.047s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] snapshot: b39e7efc-df7e-4e55-a535-5a68467c2e00, volume: 2497c9d4-148d-4e4d-9fb7-75f0225ab34c, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 10:22:56 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0273b86a-4339-4f8f-8023-8c5a4ed65b72 tempest-CreateVolumesFromSnapshotTest-600177175 None] Created volume successfully. Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a81daad-0379-4de9-861b-55eddbf283a6]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1b3d48e8-3a6e-4fcc-b7fa-76eaf832f152 tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "cinder-c990ddad-77ae-41e1-9378-f4feae10087e-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:57 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00 Jul 09 10:22:57 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1b3d48e8-3a6e-4fcc-b7fa-76eaf832f152 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-c990ddad-77ae-41e1-9378-f4feae10087e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1b3d48e8-3a6e-4fcc-b7fa-76eaf832f152 tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "cinder-quobyte-c990ddad-77ae-41e1-9378-f4feae10087e" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1b3d48e8-3a6e-4fcc-b7fa-76eaf832f152 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-quobyte-c990ddad-77ae-41e1-9378-f4feae10087e" acquired by "delete_volume" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:57 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b72034d5-a8b0-49e8-94b5-8c62f27c9ecd]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1b3d48e8-3a6e-4fcc-b7fa-76eaf832f152 tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c990ddad-77ae-41e1-9378-f4feae10087e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:57 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c990ddad-77ae-41e1-9378-f4feae10087e Jul 09 10:22:57 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:57 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00" returned: 0 in 0.933s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:22:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 10:22:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 10:22:57 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a43f673-1a7f-4cd1-9139-93813273b9c7]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:57 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 Jul 09 10:22:57 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:58 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1b3d48e8-3a6e-4fcc-b7fa-76eaf832f152 tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c990ddad-77ae-41e1-9378-f4feae10087e" returned: 0 in 0.976s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1b3d48e8-3a6e-4fcc-b7fa-76eaf832f152 tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c990ddad-77ae-41e1-9378-f4feae10087e {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:58 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c990ddad-77ae-41e1-9378-f4feae10087e Jul 09 10:22:58 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:58 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1" returned: 0 in 0.927s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:58 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Path /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2497c9d4-148d-4e4d-9fb7-75f0225ab34c not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 10:22:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2497c9d4-148d-4e4d-9fb7-75f0225ab34c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:58 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2497c9d4-148d-4e4d-9fb7-75f0225ab34c Jul 09 10:22:58 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:58 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Jul 09 10:22:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1b3d48e8-3a6e-4fcc-b7fa-76eaf832f152 tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c990ddad-77ae-41e1-9378-f4feae10087e" returned: 0 in 0.825s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:22:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1b3d48e8-3a6e-4fcc-b7fa-76eaf832f152 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-quobyte-c990ddad-77ae-41e1-9378-f4feae10087e" released by "delete_volume" :: held 1.869s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:22:59 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-1b3d48e8-3a6e-4fcc-b7fa-76eaf832f152 tempest-CreateVolumesFromSnapshotTest-600177175 None] Created reservations ['14202bc2-19c8-46b0-b854-4da85e0945ff', '4feca854-ea75-46c3-b7ab-98577c24f8b2', 'c4891ba8-fcd3-473d-a247-0605dce43759', 'e204cf12-2a1d-473b-95c3-bbeac8cdbb18'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:22:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1b3d48e8-3a6e-4fcc-b7fa-76eaf832f152 tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:22:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1b3d48e8-3a6e-4fcc-b7fa-76eaf832f152 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:22:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1b3d48e8-3a6e-4fcc-b7fa-76eaf832f152 tempest-CreateVolumesFromSnapshotTest-600177175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:22:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1b3d48e8-3a6e-4fcc-b7fa-76eaf832f152 tempest-CreateVolumesFromSnapshotTest-600177175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:22:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1b3d48e8-3a6e-4fcc-b7fa-76eaf832f152 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:22:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1b3d48e8-3a6e-4fcc-b7fa-76eaf832f152 tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:59 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:22:59 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:22:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bbca2d27-d40d-470c-a32e-1f3a0ce0ee40 tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "cinder-61c7d952-dae6-4081-adb5-4dd76c07fa33-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bbca2d27-d40d-470c-a32e-1f3a0ce0ee40 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-61c7d952-dae6-4081-adb5-4dd76c07fa33-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bbca2d27-d40d-470c-a32e-1f3a0ce0ee40 tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "cinder-quobyte-61c7d952-dae6-4081-adb5-4dd76c07fa33" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:22:59 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bbca2d27-d40d-470c-a32e-1f3a0ce0ee40 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-quobyte-61c7d952-dae6-4081-adb5-4dd76c07fa33" acquired by "delete_volume" :: waited 0.039s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:22:59 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[43935ef6-14b2-44ac-8bfe-85ba0d42c186]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:22:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbca2d27-d40d-470c-a32e-1f3a0ce0ee40 tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-61c7d952-dae6-4081-adb5-4dd76c07fa33 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:22:59 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-61c7d952-dae6-4081-adb5-4dd76c07fa33 Jul 09 10:22:59 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:00 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1b3d48e8-3a6e-4fcc-b7fa-76eaf832f152 tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.124s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:00 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-1b3d48e8-3a6e-4fcc-b7fa-76eaf832f152 tempest-CreateVolumesFromSnapshotTest-600177175 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:23:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1b3d48e8-3a6e-4fcc-b7fa-76eaf832f152 tempest-CreateVolumesFromSnapshotTest-600177175 None] Deleted volume successfully. Jul 09 10:23:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1b3d48e8-3a6e-4fcc-b7fa-76eaf832f152 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-c990ddad-77ae-41e1-9378-f4feae10087e-delete_volume" released by "delete_volume" :: held 3.397s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:01 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbca2d27-d40d-470c-a32e-1f3a0ce0ee40 tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-61c7d952-dae6-4081-adb5-4dd76c07fa33" returned: 0 in 1.568s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbca2d27-d40d-470c-a32e-1f3a0ce0ee40 tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-61c7d952-dae6-4081-adb5-4dd76c07fa33 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:01 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-61c7d952-dae6-4081-adb5-4dd76c07fa33 Jul 09 10:23:01 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:02 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbca2d27-d40d-470c-a32e-1f3a0ce0ee40 tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-61c7d952-dae6-4081-adb5-4dd76c07fa33" returned: 0 in 1.413s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bbca2d27-d40d-470c-a32e-1f3a0ce0ee40 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-quobyte-61c7d952-dae6-4081-adb5-4dd76c07fa33" released by "delete_volume" :: held 3.070s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:02 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-bbca2d27-d40d-470c-a32e-1f3a0ce0ee40 tempest-CreateVolumesFromSnapshotTest-600177175 None] Created reservations ['3022e246-c840-4e7a-87ff-97ea09022f2a', 'f3c0c734-10ae-4934-8c53-71a03f87a14f', '52f70c33-db70-4586-8d6f-7396b87b2336', 'b91d348c-6949-4c2d-876b-d7d2dca099a8'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:23:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bbca2d27-d40d-470c-a32e-1f3a0ce0ee40 tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bbca2d27-d40d-470c-a32e-1f3a0ce0ee40 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bbca2d27-d40d-470c-a32e-1f3a0ce0ee40 tempest-CreateVolumesFromSnapshotTest-600177175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-bbca2d27-d40d-470c-a32e-1f3a0ce0ee40 tempest-CreateVolumesFromSnapshotTest-600177175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bbca2d27-d40d-470c-a32e-1f3a0ce0ee40 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbca2d27-d40d-470c-a32e-1f3a0ce0ee40 tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:03 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:23:03 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d1f8e424-e372-4c83-94eb-c45d941aa76f tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "cinder-cc5accd6-4fed-4283-8e21-fe1e3e5474aa-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d1f8e424-e372-4c83-94eb-c45d941aa76f tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-cc5accd6-4fed-4283-8e21-fe1e3e5474aa-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d1f8e424-e372-4c83-94eb-c45d941aa76f tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "cinder-quobyte-cc5accd6-4fed-4283-8e21-fe1e3e5474aa" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d1f8e424-e372-4c83-94eb-c45d941aa76f tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-quobyte-cc5accd6-4fed-4283-8e21-fe1e3e5474aa" acquired by "delete_volume" :: waited 0.031s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:03 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b864869c-c419-461a-bc05-9338ab5fe298]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d1f8e424-e372-4c83-94eb-c45d941aa76f tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cc5accd6-4fed-4283-8e21-fe1e3e5474aa {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:03 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cc5accd6-4fed-4283-8e21-fe1e3e5474aa Jul 09 10:23:03 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:04 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d1f8e424-e372-4c83-94eb-c45d941aa76f tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cc5accd6-4fed-4283-8e21-fe1e3e5474aa" returned: 0 in 1.285s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d1f8e424-e372-4c83-94eb-c45d941aa76f tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cc5accd6-4fed-4283-8e21-fe1e3e5474aa {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:04 devstack sudo[106204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cc5accd6-4fed-4283-8e21-fe1e3e5474aa Jul 09 10:23:04 devstack sudo[106204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:05 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bbca2d27-d40d-470c-a32e-1f3a0ce0ee40 tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 2.188s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:05 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-bbca2d27-d40d-470c-a32e-1f3a0ce0ee40 tempest-CreateVolumesFromSnapshotTest-600177175 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:23:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-bbca2d27-d40d-470c-a32e-1f3a0ce0ee40 tempest-CreateVolumesFromSnapshotTest-600177175 None] Deleted volume successfully. Jul 09 10:23:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-bbca2d27-d40d-470c-a32e-1f3a0ce0ee40 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-61c7d952-dae6-4081-adb5-4dd76c07fa33-delete_volume" released by "delete_volume" :: held 5.814s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:05 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:23:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Flow 'volume_create_manager' (7fbf1228-45a1-491d-9835-b4d1787d7e54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1a9412-7503-4ba9-95eb-95dad2c82d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f1a9412-7503-4ba9-95eb-95dad2c82d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d9cc02-2888-4fbe-97fa-547a52a7e0f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e2ef27bf6c493a834214fb6a01f7c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:05Z,use_quota=True,user_id='1bd2351119d7436cba09f0ec0e8646ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6c674a-619a-41d0-b2a5-11e12df46524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a6c674a-619a-41d0-b2a5-11e12df46524) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466a757e-d968-45c4-b405-21b2554ea7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:05 devstack cinder-volume[87192]: DEBUG cinder.image.glance [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Creating Keystone auth plugin from conf {{(pid=87192) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 09 10:23:05 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2497c9d4-148d-4e4d-9fb7-75f0225ab34c" returned: 0 in 6.951s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:05 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[094d492d-fe1b-41fd-8dc9-c98f08261fa8]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (466a757e-d968-45c4-b405-21b2554ea7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '59d9cc02-2888-4fbe-97fa-547a52a7e0f2', 'volume_name': 'volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2', 'volume_size': 1, 'image_id': '2740ad4e-66c5-49d3-8402-275c7c7781a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2740ad4e-66c5-49d3-8402-275c7c7781a4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '312f716439f7a5fe57a2d6d0bd610cdf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a1e2ef27bf6c493a834214fb6a01f7c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'addea94b253d8c5c66fef8b7c48842a0eace359a764f7e8928e300c2d34c692f5706287e3426570c825395715de616d7bef93713a77941e9b6a2c5b4fd194694', 'id': '2740ad4e-66c5-49d3-8402-275c7c7781a4', 'created_at': datetime.datetime(2026, 7, 9, 8, 22, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 8, 23, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2740ad4e-66c5-49d3-8402-275c7c7781a4/file', 'properties': {}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c9d824-6202-441b-96e2-6cdc4a47a2ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6c9d824-6202-441b-96e2-6cdc4a47a2ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:05 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a324b9-6ea1-423c-bbb7-07b304b02652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:05 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Volume 59d9cc02-2888-4fbe-97fa-547a52a7e0f2: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2', 'volume_size': 1, 'image_id': '2740ad4e-66c5-49d3-8402-275c7c7781a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2740ad4e-66c5-49d3-8402-275c7c7781a4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '312f716439f7a5fe57a2d6d0bd610cdf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a1e2ef27bf6c493a834214fb6a01f7c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'addea94b253d8c5c66fef8b7c48842a0eace359a764f7e8928e300c2d34c692f5706287e3426570c825395715de616d7bef93713a77941e9b6a2c5b4fd194694', 'id': '2740ad4e-66c5-49d3-8402-275c7c7781a4', 'created_at': datetime.datetime(2026, 7, 9, 8, 22, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 8, 23, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2740ad4e-66c5-49d3-8402-275c7c7781a4/file', 'properties': {}}, 'image_service': } Jul 09 10:23:05 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Trying to clone 59d9cc02-2888-4fbe-97fa-547a52a7e0f2 from image 2740ad4e-66c5-49d3-8402-275c7c7781a4 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2740ad4e-66c5-49d3-8402-275c7c7781a4', 'metadata': {}}]). {{(pid=87192) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 09 10:23:05 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 Jul 09 10:23:05 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:06 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 09 10:23:06 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Image download 0.00 MB at 0.00 MB/s Jul 09 10:23:06 devstack sudo[106204]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d1f8e424-e372-4c83-94eb-c45d941aa76f tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-cc5accd6-4fed-4283-8e21-fe1e3e5474aa" returned: 0 in 1.274s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:06 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[bec60f38-77ae-47cb-90b9-53849a385695]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d1f8e424-e372-4c83-94eb-c45d941aa76f tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-quobyte-cc5accd6-4fed-4283-8e21-fe1e3e5474aa" released by "delete_volume" :: held 2.702s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:06 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d1f8e424-e372-4c83-94eb-c45d941aa76f tempest-CreateVolumesFromSnapshotTest-600177175 None] Created reservations ['d67b2035-9571-4fe5-bfb6-9e3ad6d37a34', 'f13df8ce-bc9b-4ba8-84ce-13e3a08021c9', 'a17950ad-3684-4e72-ad7f-0cd3e0fdca0a', 'b03063ba-a432-455d-8aab-51d50b70d595'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:23:06 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD Jul 09 10:23:06 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d1f8e424-e372-4c83-94eb-c45d941aa76f tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d1f8e424-e372-4c83-94eb-c45d941aa76f tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d1f8e424-e372-4c83-94eb-c45d941aa76f tempest-CreateVolumesFromSnapshotTest-600177175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d1f8e424-e372-4c83-94eb-c45d941aa76f tempest-CreateVolumesFromSnapshotTest-600177175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d1f8e424-e372-4c83-94eb-c45d941aa76f tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d1f8e424-e372-4c83-94eb-c45d941aa76f tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:06 devstack sudo[106211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:23:06 devstack sudo[106211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8d4d2d41-45b9-4bcc-a662-65cde646a886 tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "cinder-abebef2d-ff3e-410a-9341-795bb6549bdf-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8d4d2d41-45b9-4bcc-a662-65cde646a886 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-abebef2d-ff3e-410a-9341-795bb6549bdf-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8d4d2d41-45b9-4bcc-a662-65cde646a886 tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "cinder-quobyte-abebef2d-ff3e-410a-9341-795bb6549bdf" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8d4d2d41-45b9-4bcc-a662-65cde646a886 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-quobyte-abebef2d-ff3e-410a-9341-795bb6549bdf" acquired by "delete_volume" :: waited 0.027s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:07 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9872c431-8624-449c-bef0-6b666be1dd49]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8d4d2d41-45b9-4bcc-a662-65cde646a886 tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-abebef2d-ff3e-410a-9341-795bb6549bdf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:07 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD" returned: 0 in 0.957s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:07 devstack sudo[106211]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d1f8e424-e372-4c83-94eb-c45d941aa76f tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.801s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:07 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-d1f8e424-e372-4c83-94eb-c45d941aa76f tempest-CreateVolumesFromSnapshotTest-600177175 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:23:07 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d1f8e424-e372-4c83-94eb-c45d941aa76f tempest-CreateVolumesFromSnapshotTest-600177175 None] Deleted volume successfully. Jul 09 10:23:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1" returned: 0 in 1.402s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:07 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Image conversion details: src /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1, size 1024.00 MB, duration 6.95 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2497c9d4-148d-4e4d-9fb7-75f0225ab34c {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:23:07 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Converted 1024.00 MB image at 147.29 MB/s Jul 09 10:23:07 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2497c9d4-148d-4e4d-9fb7-75f0225ab34c is being set with open permissions: ugo+rw Jul 09 10:23:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2497c9d4-148d-4e4d-9fb7-75f0225ab34c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d1f8e424-e372-4c83-94eb-c45d941aa76f tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-cc5accd6-4fed-4283-8e21-fe1e3e5474aa-delete_volume" released by "delete_volume" :: held 3.952s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:07 devstack sudo[106222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2497c9d4-148d-4e4d-9fb7-75f0225ab34c Jul 09 10:23:07 devstack sudo[106222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:07 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-abebef2d-ff3e-410a-9341-795bb6549bdf Jul 09 10:23:07 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:07 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD Jul 09 10:23:07 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:07 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD" returned: 1 in 0.855s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:23:07 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Temporary image 2740ad4e-66c5-49d3-8402-275c7c7781a4 is fetched for user 1bd2351119d7436cba09f0ec0e8646ce. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 09 10:23:08 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8d4d2d41-45b9-4bcc-a662-65cde646a886 tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-abebef2d-ff3e-410a-9341-795bb6549bdf" returned: 0 in 1.014s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8d4d2d41-45b9-4bcc-a662-65cde646a886 tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-abebef2d-ff3e-410a-9341-795bb6549bdf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:08 devstack sudo[106222]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2497c9d4-148d-4e4d-9fb7-75f0225ab34c" returned: 0 in 0.911s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:08 devstack sudo[106233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-abebef2d-ff3e-410a-9341-795bb6549bdf Jul 09 10:23:08 devstack sudo[106233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Lock "cinder-quobyte-2497c9d4-148d-4e4d-9fb7-75f0225ab34c" released by "_copy_volume_from_snapshot" :: held 11.283s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Lock "cinder-quobyte-b39e7efc-df7e-4e55-a535-5a68467c2e00-2497c9d4-148d-4e4d-9fb7-75f0225ab34c" released by "_create_volume_from_snapshot" :: held 11.353s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.392s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[54ce1171-6dd5-489f-84eb-084b0b618274]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99f730ed-108c-44b9-a20c-63bf802118f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2497c9d4-148d-4e4d-9fb7-75f0225ab34c', 'volume_size': 1, 'snapshot_id': 'b39e7efc-df7e-4e55-a535-5a68467c2e00'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66add20b-c87b-4ecf-a7d4-416559df1269) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Volume volume-2497c9d4-148d-4e4d-9fb7-75f0225ab34c (2497c9d4-148d-4e4d-9fb7-75f0225ab34c): created successfully Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66add20b-c87b-4ecf-a7d4-416559df1269) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Flow 'volume_create_manager' (06f486a5-fd17-4422-8589-2f8c0eeafcbb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9da4dae3-0d0e-471d-bcb6-a189d6cede51 tempest-VolumeDependencyTests-2079059416 None] Created volume successfully. Jul 09 10:23:08 devstack sudo[106235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD Jul 09 10:23:08 devstack sudo[106235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] Acquiring lock "cinder-b39e7efc-df7e-4e55-a535-5a68467c2e00-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] Lock "cinder-b39e7efc-df7e-4e55-a535-5a68467c2e00-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] Acquiring lock "cinder-quobyte-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] Lock "cinder-quobyte-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] Acquiring lock "cinder-quobyte-b39e7efc-df7e-4e55-a535-5a68467c2e00" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] Lock "cinder-quobyte-b39e7efc-df7e-4e55-a535-5a68467c2e00" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] Deleting offline snapshot b39e7efc-df7e-4e55-a535-5a68467c2e00 of volume 1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] snapshot_file for this snap is: volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[09089e60-b171-4b93-8802-db6cbc087d6a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:08 devstack sudo[106233]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8d4d2d41-45b9-4bcc-a662-65cde646a886 tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-abebef2d-ff3e-410a-9341-795bb6549bdf" returned: 0 in 0.917s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8d4d2d41-45b9-4bcc-a662-65cde646a886 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-quobyte-abebef2d-ff3e-410a-9341-795bb6549bdf" released by "delete_volume" :: held 1.987s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:08 devstack sudo[106235]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD" returned: 0 in 0.899s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:09 devstack sudo[106239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00 Jul 09 10:23:09 devstack sudo[106239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:09 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-8d4d2d41-45b9-4bcc-a662-65cde646a886 tempest-CreateVolumesFromSnapshotTest-600177175 None] Created reservations ['65368c4c-96b0-4682-8400-81613cfd26ea', '13c20d19-e8c8-4eba-a6eb-e3856bf6f6ec', '6ff7708c-616c-4937-9023-a38a96ab9254', '8505ab91-aa50-411c-b96b-4f38c3054eeb'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:23:09 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD Jul 09 10:23:09 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8d4d2d41-45b9-4bcc-a662-65cde646a886 tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8d4d2d41-45b9-4bcc-a662-65cde646a886 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8d4d2d41-45b9-4bcc-a662-65cde646a886 tempest-CreateVolumesFromSnapshotTest-600177175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8d4d2d41-45b9-4bcc-a662-65cde646a886 tempest-CreateVolumesFromSnapshotTest-600177175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8d4d2d41-45b9-4bcc-a662-65cde646a886 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8d4d2d41-45b9-4bcc-a662-65cde646a886 tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:09 devstack sudo[106245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:23:09 devstack sudo[106245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:09 devstack sudo[106239]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00" returned: 0 in 1.070s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:23:09 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2322379-30f1-41a5-9ae2-678bce177b14]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:10 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 Jul 09 10:23:10 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:10 devstack sudo[106245]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8d4d2d41-45b9-4bcc-a662-65cde646a886 tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.060s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-8d4d2d41-45b9-4bcc-a662-65cde646a886 tempest-CreateVolumesFromSnapshotTest-600177175 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:23:10 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8d4d2d41-45b9-4bcc-a662-65cde646a886 tempest-CreateVolumesFromSnapshotTest-600177175 None] Deleted volume successfully. Jul 09 10:23:10 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD" returned: 1 in 1.366s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:04Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d9cc02-2888-4fbe-97fa-547a52a7e0f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a1e2ef27bf6c493a834214fb6a01f7c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:05Z,use_quota=True,user_id='1bd2351119d7436cba09f0ec0e8646ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Creating volume 59d9cc02-2888-4fbe-97fa-547a52a7e0f2 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:23:10 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b0290741-c66b-4279-90b2-13696a40a87c tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "cinder-c7bf5782-41bd-4af5-a690-b123ce7e9c70-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8d4d2d41-45b9-4bcc-a662-65cde646a886 tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-abebef2d-ff3e-410a-9341-795bb6549bdf-delete_volume" released by "delete_volume" :: held 3.578s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:10 devstack sudo[106256]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 1073741824 Jul 09 10:23:10 devstack sudo[106256]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b0290741-c66b-4279-90b2-13696a40a87c tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-c7bf5782-41bd-4af5-a690-b123ce7e9c70-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b0290741-c66b-4279-90b2-13696a40a87c tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "cinder-quobyte-c7bf5782-41bd-4af5-a690-b123ce7e9c70" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b0290741-c66b-4279-90b2-13696a40a87c tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-quobyte-c7bf5782-41bd-4af5-a690-b123ce7e9c70" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1b490be-a3e6-4922-a01a-cc763a14a6e0]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b0290741-c66b-4279-90b2-13696a40a87c tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c7bf5782-41bd-4af5-a690-b123ce7e9c70 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:10 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c7bf5782-41bd-4af5-a690-b123ce7e9c70 Jul 09 10:23:10 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:11 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1" returned: 0 in 1.055s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:11 devstack sudo[106264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00 Jul 09 10:23:11 devstack sudo[106264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:11 devstack sudo[106256]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 1073741824" returned: 0 in 1.268s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:11 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b0290741-c66b-4279-90b2-13696a40a87c tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c7bf5782-41bd-4af5-a690-b123ce7e9c70" returned: 0 in 1.068s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b0290741-c66b-4279-90b2-13696a40a87c tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c7bf5782-41bd-4af5-a690-b123ce7e9c70 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:11 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c7bf5782-41bd-4af5-a690-b123ce7e9c70 Jul 09 10:23:11 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:11 devstack sudo[106273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 Jul 09 10:23:11 devstack sudo[106273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:12 devstack sudo[106264]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00" returned: 0 in 1.023s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:12 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00 Jul 09 10:23:12 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:12 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b0290741-c66b-4279-90b2-13696a40a87c tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c7bf5782-41bd-4af5-a690-b123ce7e9c70" returned: 0 in 0.766s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b0290741-c66b-4279-90b2-13696a40a87c tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-quobyte-c7bf5782-41bd-4af5-a690-b123ce7e9c70" released by "delete_volume" :: held 1.885s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:12 devstack sudo[106273]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2" returned: 0 in 0.815s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] <== create_volume: return (2149ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.157s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-b0290741-c66b-4279-90b2-13696a40a87c tempest-CreateVolumesFromSnapshotTest-600177175 None] Created reservations ['c34dea58-143d-4fe6-ab46-1377bdcedd54', '5508157e-e96c-4194-b3f8-1c223dd0a69e', 'cf78e839-7dce-4f49-8d14-1b9e9caa0c2c', 'b6e21e06-e0b5-404d-ad34-f6bebab58b69'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Attempting download of 2740ad4e-66c5-49d3-8402-275c7c7781a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/2740ad4e-66c5-49d3-8402-275c7c7781a4', 'metadata': {}}])) to volume 59d9cc02-2888-4fbe-97fa-547a52a7e0f2. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[71fadf79-ef04-43a7-997c-eb9a76a66b82]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2740ad4e-66c5-49d3-8402-275c7c7781a4_ec63k5li {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b0290741-c66b-4279-90b2-13696a40a87c tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b0290741-c66b-4279-90b2-13696a40a87c tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b0290741-c66b-4279-90b2-13696a40a87c tempest-CreateVolumesFromSnapshotTest-600177175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b0290741-c66b-4279-90b2-13696a40a87c tempest-CreateVolumesFromSnapshotTest-600177175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b0290741-c66b-4279-90b2-13696a40a87c tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b0290741-c66b-4279-90b2-13696a40a87c tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "cinder-02fb9655-2eba-4431-9763-3169f003eba3-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:12 devstack sudo[106284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:23:12 devstack sudo[106284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-02fb9655-2eba-4431-9763-3169f003eba3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "cinder-quobyte-c01db1c8-9e03-4376-9738-f6abdf3f101b" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-quobyte-c01db1c8-9e03-4376-9738-f6abdf3f101b" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "cinder-quobyte-02fb9655-2eba-4431-9763-3169f003eba3" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-quobyte-02fb9655-2eba-4431-9763-3169f003eba3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] Deleting offline snapshot 02fb9655-2eba-4431-9763-3169f003eba3 of volume c01db1c8-9e03-4376-9738-f6abdf3f101b {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] snapshot_file for this snap is: volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.02fb9655-2eba-4431-9763-3169f003eba3 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:23:12 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2740ad4e-66c5-49d3-8402-275c7c7781a4_ec63k5li Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e9e01c6-2e8e-47eb-8aad-885764ba2e6a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.02fb9655-2eba-4431-9763-3169f003eba3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:12 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:12 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1.b39e7efc-df7e-4e55-a535-5a68467c2e00" returned: 0 in 0.874s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] Lock "cinder-quobyte-b39e7efc-df7e-4e55-a535-5a68467c2e00" released by "_delete_snapshot" :: held 4.213s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] Lock "cinder-quobyte-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1" released by "delete_snapshot" :: held 4.259s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:13 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.02fb9655-2eba-4431-9763-3169f003eba3 Jul 09 10:23:13 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:13 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] Created reservations ['04372f33-8953-42b3-98a8-4d7062ba2e86', 'e688cf9d-7b3a-4f97-b884-8f97ffe1b357', '84b92a6e-41c8-44d5-9fb6-281df84b9ae9', 'b4e21af2-bd43-4ea5-b28a-1ace5875e92d'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:23:13 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] Delete snapshot completed successfully. Jul 09 10:23:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-50d89eaa-e9a5-4ed8-a085-caac0eb45257 tempest-VolumeDependencyTests-2079059416 None] Lock "cinder-b39e7efc-df7e-4e55-a535-5a68467c2e00-delete_snapshot" released by "delete_snapshot" :: held 4.540s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:13 devstack sudo[106284]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b0290741-c66b-4279-90b2-13696a40a87c tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.883s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:13 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-b0290741-c66b-4279-90b2-13696a40a87c tempest-CreateVolumesFromSnapshotTest-600177175 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:23:13 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b0290741-c66b-4279-90b2-13696a40a87c tempest-CreateVolumesFromSnapshotTest-600177175 None] Deleted volume successfully. Jul 09 10:23:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b0290741-c66b-4279-90b2-13696a40a87c tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-c7bf5782-41bd-4af5-a690-b123ce7e9c70-delete_volume" released by "delete_volume" :: held 3.159s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:13 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2740ad4e-66c5-49d3-8402-275c7c7781a4_ec63k5li" returned: 0 in 1.145s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2740ad4e-66c5-49d3-8402-275c7c7781a4_ec63k5li {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:13 devstack sudo[106293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2740ad4e-66c5-49d3-8402-275c7c7781a4_ec63k5li Jul 09 10:23:13 devstack sudo[106293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:13 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.02fb9655-2eba-4431-9763-3169f003eba3" returned: 0 in 1.096s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c01db1c8-9e03-4376-9738-f6abdf3f101b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:23:14 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acb768b-39a9-46ab-b0ac-dad64817fd6c]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5d5a0585-57c9-48d3-9311-6aab2c74cbc5 tempest-VolumeDependencyTests-2079059416 None] Acquiring lock "cinder-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5d5a0585-57c9-48d3-9311-6aab2c74cbc5 tempest-VolumeDependencyTests-2079059416 None] Lock "cinder-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:14 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b Jul 09 10:23:14 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5d5a0585-57c9-48d3-9311-6aab2c74cbc5 tempest-VolumeDependencyTests-2079059416 None] Acquiring lock "cinder-quobyte-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:14 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5d5a0585-57c9-48d3-9311-6aab2c74cbc5 tempest-VolumeDependencyTests-2079059416 None] Lock "cinder-quobyte-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:14 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[6aff7606-8dda-494e-a574-74cd84b5618b]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5d5a0585-57c9-48d3-9311-6aab2c74cbc5 tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:14 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 Jul 09 10:23:14 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:14 devstack sudo[106293]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2740ad4e-66c5-49d3-8402-275c7c7781a4_ec63k5li" returned: 1 in 0.889s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2740ad4e-66c5-49d3-8402-275c7c7781a4_ec63k5li' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:23:14 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[12fae582-3880-4aba-b98b-5fd3e42ef911]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:14 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b" returned: 0 in 0.891s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.02fb9655-2eba-4431-9763-3169f003eba3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:14 devstack sudo[106305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD Jul 09 10:23:14 devstack sudo[106305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:14 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.02fb9655-2eba-4431-9763-3169f003eba3 Jul 09 10:23:14 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:15 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5d5a0585-57c9-48d3-9311-6aab2c74cbc5 tempest-VolumeDependencyTests-2079059416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1" returned: 0 in 0.951s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5d5a0585-57c9-48d3-9311-6aab2c74cbc5 tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:15 devstack sudo[106316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1 Jul 09 10:23:15 devstack sudo[106316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:15 devstack sudo[106305]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD" returned: 0 in 0.954s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:15 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.02fb9655-2eba-4431-9763-3169f003eba3" returned: 0 in 0.846s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.02fb9655-2eba-4431-9763-3169f003eba3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:15 devstack sudo[106324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD Jul 09 10:23:15 devstack sudo[106324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:15 devstack sudo[106325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.02fb9655-2eba-4431-9763-3169f003eba3 Jul 09 10:23:15 devstack sudo[106325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:16 devstack sudo[106316]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5d5a0585-57c9-48d3-9311-6aab2c74cbc5 tempest-VolumeDependencyTests-2079059416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1" returned: 0 in 0.917s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5d5a0585-57c9-48d3-9311-6aab2c74cbc5 tempest-VolumeDependencyTests-2079059416 None] Lock "cinder-quobyte-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1" released by "delete_volume" :: held 1.936s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-5d5a0585-57c9-48d3-9311-6aab2c74cbc5 tempest-VolumeDependencyTests-2079059416 None] Created reservations ['df7da950-0d3f-4c7e-8fc4-4995c4165324', '8a9f7635-8d1c-40ca-869a-7540201d5ee8', 'b7ec8e04-6ba2-463b-bc34-3449fd72320e', 'd4382e6e-84de-4745-839a-fa54cf00c40e'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5d5a0585-57c9-48d3-9311-6aab2c74cbc5 tempest-VolumeDependencyTests-2079059416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5d5a0585-57c9-48d3-9311-6aab2c74cbc5 tempest-VolumeDependencyTests-2079059416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5d5a0585-57c9-48d3-9311-6aab2c74cbc5 tempest-VolumeDependencyTests-2079059416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-5d5a0585-57c9-48d3-9311-6aab2c74cbc5 tempest-VolumeDependencyTests-2079059416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-5d5a0585-57c9-48d3-9311-6aab2c74cbc5 tempest-VolumeDependencyTests-2079059416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5d5a0585-57c9-48d3-9311-6aab2c74cbc5 tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:16 devstack sudo[106330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:23:16 devstack sudo[106330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef675437-f1e1-415c-a74c-f610718c87cb tempest-VolumeDependencyTests-2079059416 None] Acquiring lock "cinder-2497c9d4-148d-4e4d-9fb7-75f0225ab34c-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef675437-f1e1-415c-a74c-f610718c87cb tempest-VolumeDependencyTests-2079059416 None] Lock "cinder-2497c9d4-148d-4e4d-9fb7-75f0225ab34c-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef675437-f1e1-415c-a74c-f610718c87cb tempest-VolumeDependencyTests-2079059416 None] Acquiring lock "cinder-quobyte-2497c9d4-148d-4e4d-9fb7-75f0225ab34c" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef675437-f1e1-415c-a74c-f610718c87cb tempest-VolumeDependencyTests-2079059416 None] Lock "cinder-quobyte-2497c9d4-148d-4e4d-9fb7-75f0225ab34c" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab353b6-b87f-4a05-8208-a5eca015c938]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef675437-f1e1-415c-a74c-f610718c87cb tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2497c9d4-148d-4e4d-9fb7-75f0225ab34c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:16 devstack sudo[106324]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD" returned: 1 in 0.999s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] 2740ad4e-66c5-49d3-8402-275c7c7781a4 was raw, converting to raw {{(pid=87192) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:16 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 Jul 09 10:23:16 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:16 devstack sudo[106335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2497c9d4-148d-4e4d-9fb7-75f0225ab34c Jul 09 10:23:16 devstack sudo[106335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:16 devstack sudo[106325]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b.02fb9655-2eba-4431-9763-3169f003eba3" returned: 0 in 1.117s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-quobyte-02fb9655-2eba-4431-9763-3169f003eba3" released by "_delete_snapshot" :: held 4.132s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-quobyte-c01db1c8-9e03-4376-9738-f6abdf3f101b" released by "delete_snapshot" :: held 4.171s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:17 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] Created reservations ['191ceca8-f13d-45a4-94ae-5d8f38951035', 'd653721a-3dc9-491a-a2c7-bb638e03e109', 'db2ac0ea-ffce-4f93-9fcc-dca494b8c958', '9f0bde2b-c22e-44a1-9dc0-ed71c29e23e7'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:23:17 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] Delete snapshot completed successfully. Jul 09 10:23:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-82d0f649-29d8-47f4-85e6-71cc652ff0bf tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-02fb9655-2eba-4431-9763-3169f003eba3-delete_snapshot" released by "delete_snapshot" :: held 4.509s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:17 devstack sudo[106330]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-5d5a0585-57c9-48d3-9311-6aab2c74cbc5 tempest-VolumeDependencyTests-2079059416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.879s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:17 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-5d5a0585-57c9-48d3-9311-6aab2c74cbc5 tempest-VolumeDependencyTests-2079059416 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:23:17 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-5d5a0585-57c9-48d3-9311-6aab2c74cbc5 tempest-VolumeDependencyTests-2079059416 None] Deleted volume successfully. Jul 09 10:23:17 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-5d5a0585-57c9-48d3-9311-6aab2c74cbc5 tempest-VolumeDependencyTests-2079059416 None] Lock "cinder-1f339c24-8ca8-4c8d-9daa-2ce843f5eaa1-delete_volume" released by "delete_volume" :: held 3.139s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:17 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2" returned: 0 in 1.009s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:17 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2740ad4e-66c5-49d3-8402-275c7c7781a4_s0ve0094devstack@QuobyteHD, size 0.00 MB, duration 1.01 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:23:17 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Converted 0.00 MB image at 0.00 MB/s Jul 09 10:23:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:17 devstack sudo[106344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 1G Jul 09 10:23:17 devstack sudo[106344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:17 devstack sudo[106335]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef675437-f1e1-415c-a74c-f610718c87cb tempest-VolumeDependencyTests-2079059416 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2497c9d4-148d-4e4d-9fb7-75f0225ab34c" returned: 0 in 1.208s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef675437-f1e1-415c-a74c-f610718c87cb tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2497c9d4-148d-4e4d-9fb7-75f0225ab34c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:17 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2497c9d4-148d-4e4d-9fb7-75f0225ab34c Jul 09 10:23:17 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a4544373-1dcb-42a0-b929-6cfa1e3d7d1f tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "cinder-c01db1c8-9e03-4376-9738-f6abdf3f101b-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a4544373-1dcb-42a0-b929-6cfa1e3d7d1f tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-c01db1c8-9e03-4376-9738-f6abdf3f101b-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a4544373-1dcb-42a0-b929-6cfa1e3d7d1f tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "cinder-quobyte-c01db1c8-9e03-4376-9738-f6abdf3f101b" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a4544373-1dcb-42a0-b929-6cfa1e3d7d1f tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-quobyte-c01db1c8-9e03-4376-9738-f6abdf3f101b" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:18 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa415e38-ece2-4cb1-be87-8cf725db75eb]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a4544373-1dcb-42a0-b929-6cfa1e3d7d1f tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:18 devstack sudo[106344]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 1G" returned: 0 in 0.876s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:18 devstack sudo[106356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b Jul 09 10:23:18 devstack sudo[106356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:18 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f9e6fc0-a933-4177-8df3-26b0da20f693]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:18 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef675437-f1e1-415c-a74c-f610718c87cb tempest-VolumeDependencyTests-2079059416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-2497c9d4-148d-4e4d-9fb7-75f0225ab34c" returned: 0 in 0.946s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:18 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 Jul 09 10:23:18 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef675437-f1e1-415c-a74c-f610718c87cb tempest-VolumeDependencyTests-2079059416 None] Lock "cinder-quobyte-2497c9d4-148d-4e4d-9fb7-75f0225ab34c" released by "delete_volume" :: held 2.229s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:18 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ef675437-f1e1-415c-a74c-f610718c87cb tempest-VolumeDependencyTests-2079059416 None] Created reservations ['366c1950-d3a5-4537-8db7-5410e72b97fb', 'b2f9cd92-1078-4b8c-890e-01dd841272c5', '9b5532bd-2243-4b0a-b4d4-ab32993757f7', '9c413d99-5bca-4db9-8eec-a65228c1a33c'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:23:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef675437-f1e1-415c-a74c-f610718c87cb tempest-VolumeDependencyTests-2079059416 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef675437-f1e1-415c-a74c-f610718c87cb tempest-VolumeDependencyTests-2079059416 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ef675437-f1e1-415c-a74c-f610718c87cb tempest-VolumeDependencyTests-2079059416 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ef675437-f1e1-415c-a74c-f610718c87cb tempest-VolumeDependencyTests-2079059416 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ef675437-f1e1-415c-a74c-f610718c87cb tempest-VolumeDependencyTests-2079059416 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef675437-f1e1-415c-a74c-f610718c87cb tempest-VolumeDependencyTests-2079059416 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:19 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:23:19 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:19 devstack sudo[106356]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a4544373-1dcb-42a0-b929-6cfa1e3d7d1f tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b" returned: 0 in 1.105s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a4544373-1dcb-42a0-b929-6cfa1e3d7d1f tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:19 devstack sudo[106369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b Jul 09 10:23:19 devstack sudo[106369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:19 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2" returned: 0 in 0.969s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:19 devstack sudo[106371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 Jul 09 10:23:19 devstack sudo[106371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:19 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ef675437-f1e1-415c-a74c-f610718c87cb tempest-VolumeDependencyTests-2079059416 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.715s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:19 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-ef675437-f1e1-415c-a74c-f610718c87cb tempest-VolumeDependencyTests-2079059416 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:23:19 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ef675437-f1e1-415c-a74c-f610718c87cb tempest-VolumeDependencyTests-2079059416 None] Deleted volume successfully. Jul 09 10:23:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ef675437-f1e1-415c-a74c-f610718c87cb tempest-VolumeDependencyTests-2079059416 None] Lock "cinder-2497c9d4-148d-4e4d-9fb7-75f0225ab34c-delete_volume" released by "delete_volume" :: held 3.236s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:20 devstack sudo[106369]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a4544373-1dcb-42a0-b929-6cfa1e3d7d1f tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-c01db1c8-9e03-4376-9738-f6abdf3f101b" returned: 0 in 0.768s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a4544373-1dcb-42a0-b929-6cfa1e3d7d1f tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-quobyte-c01db1c8-9e03-4376-9738-f6abdf3f101b" released by "delete_volume" :: held 1.960s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:20 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a4544373-1dcb-42a0-b929-6cfa1e3d7d1f tempest-CreateVolumesFromSnapshotTest-600177175 None] Created reservations ['f1c75c83-abcd-486b-bf35-ef01e7264727', 'adb879ba-8e65-4faf-8b37-7bc9fd0c7e13', '2beebb79-cb78-4f25-903d-00c4b1b4531d', 'a455c615-65f2-4576-8acb-23acd2e88eb1'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:23:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a4544373-1dcb-42a0-b929-6cfa1e3d7d1f tempest-CreateVolumesFromSnapshotTest-600177175 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a4544373-1dcb-42a0-b929-6cfa1e3d7d1f tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a4544373-1dcb-42a0-b929-6cfa1e3d7d1f tempest-CreateVolumesFromSnapshotTest-600177175 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a4544373-1dcb-42a0-b929-6cfa1e3d7d1f tempest-CreateVolumesFromSnapshotTest-600177175 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a4544373-1dcb-42a0-b929-6cfa1e3d7d1f tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a4544373-1dcb-42a0-b929-6cfa1e3d7d1f tempest-CreateVolumesFromSnapshotTest-600177175 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:20 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:23:20 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:20 devstack sudo[106371]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2" returned: 1 in 0.948s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:23:20 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Downloaded image 2740ad4e-66c5-49d3-8402-275c7c7781a4 ((None, [{'url': 'file:///opt/stack/data/glance/images/2740ad4e-66c5-49d3-8402-275c7c7781a4', 'metadata': {}}])) to volume 59d9cc02-2888-4fbe-97fa-547a52a7e0f2 successfully. {{(pid=87192) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 09 10:23:20 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Temporary image 2740ad4e-66c5-49d3-8402-275c7c7781a4 for user 1bd2351119d7436cba09f0ec0e8646ce is deleted. {{(pid=87192) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 09 10:23:20 devstack cinder-volume[87192]: DEBUG cinder.volume.volume_utils [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Marking volume 59d9cc02-2888-4fbe-97fa-547a52a7e0f2 as bootable. {{(pid=87192) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 09 10:23:20 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Copying metadata from image 2740ad4e-66c5-49d3-8402-275c7c7781a4 to 59d9cc02-2888-4fbe-97fa-547a52a7e0f2. {{(pid=87192) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 09 10:23:20 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Creating volume glance metadata for volume 59d9cc02-2888-4fbe-97fa-547a52a7e0f2 backed by image 2740ad4e-66c5-49d3-8402-275c7c7781a4 with: {'image_id': '2740ad4e-66c5-49d3-8402-275c7c7781a4', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '312f716439f7a5fe57a2d6d0bd610cdf', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87192) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 09 10:23:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47a324b9-6ea1-423c-bbb7-07b304b02652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2', 'volume_size': 1, 'image_id': '2740ad4e-66c5-49d3-8402-275c7c7781a4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2740ad4e-66c5-49d3-8402-275c7c7781a4', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '312f716439f7a5fe57a2d6d0bd610cdf', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a1e2ef27bf6c493a834214fb6a01f7c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'addea94b253d8c5c66fef8b7c48842a0eace359a764f7e8928e300c2d34c692f5706287e3426570c825395715de616d7bef93713a77941e9b6a2c5b4fd194694', 'id': '2740ad4e-66c5-49d3-8402-275c7c7781a4', 'created_at': datetime.datetime(2026, 7, 9, 8, 22, 59, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 9, 8, 23, 2, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2740ad4e-66c5-49d3-8402-275c7c7781a4/file', 'properties': {}}, 'image_service': }' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c48e0ba-2460-4b6f-9a6a-32cff6165abf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:20 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Volume volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 (59d9cc02-2888-4fbe-97fa-547a52a7e0f2): created successfully Jul 09 10:23:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c48e0ba-2460-4b6f-9a6a-32cff6165abf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:20 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Flow 'volume_create_manager' (7fbf1228-45a1-491d-9835-b4d1787d7e54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-07062cd9-240c-409f-9fec-3f2e34054268 tempest-VolumeImageDependencyTests-588547797 None] Created volume successfully. Jul 09 10:23:21 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a4544373-1dcb-42a0-b929-6cfa1e3d7d1f tempest-CreateVolumesFromSnapshotTest-600177175 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.026s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:21 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a4544373-1dcb-42a0-b929-6cfa1e3d7d1f tempest-CreateVolumesFromSnapshotTest-600177175 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:23:21 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a4544373-1dcb-42a0-b929-6cfa1e3d7d1f tempest-CreateVolumesFromSnapshotTest-600177175 None] Deleted volume successfully. Jul 09 10:23:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a4544373-1dcb-42a0-b929-6cfa1e3d7d1f tempest-CreateVolumesFromSnapshotTest-600177175 None] Lock "cinder-c01db1c8-9e03-4376-9738-f6abdf3f101b-delete_volume" released by "delete_volume" :: held 3.269s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] Acquiring lock "cinder-59d9cc02-2888-4fbe-97fa-547a52a7e0f2-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] Lock "cinder-59d9cc02-2888-4fbe-97fa-547a52a7e0f2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] Acquiring lock "cinder-quobyte-59d9cc02-2888-4fbe-97fa-547a52a7e0f2" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] Lock "cinder-quobyte-59d9cc02-2888-4fbe-97fa-547a52a7e0f2" acquired by "delete_volume" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:21 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ebd365-eb0b-4b75-89fe-3bf09031f358]: (4, 'raw') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:22 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 Jul 09 10:23:22 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:23 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2" returned: 0 in 1.029s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:23 devstack sudo[106385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 Jul 09 10:23:23 devstack sudo[106385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:24 devstack sudo[106385]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2" returned: 1 in 1.250s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2' failed. Not Retrying. {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 09 10:23:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:24 devstack sudo[106390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2 Jul 09 10:23:24 devstack sudo[106390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:25 devstack sudo[106390]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-59d9cc02-2888-4fbe-97fa-547a52a7e0f2" returned: 0 in 1.063s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] Lock "cinder-quobyte-59d9cc02-2888-4fbe-97fa-547a52a7e0f2" released by "delete_volume" :: held 3.423s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=133,cinder:UPDATE=170,cinder:INSERT=52,cinder:DELETE=16 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=131,cinder:UPDATE=177,cinder:DELETE=15,cinder:INSERT=47 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] Created reservations ['286d4c7e-ed22-4279-b824-e36fca64908b', '0e57f1d8-e862-48ab-989e-a253db8f029f', '8dd8561a-2937-4f8b-ae2e-77c4ce11f583', '0a8f6ba1-3c03-4e9d-9e00-334615f749d1'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Flow 'volume_create_manager' (1394011e-95fa-49a3-871a-11306918efcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f806ef50-eb59-4b3c-94d4-4187d8217260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f806ef50-eb59-4b3c-94d4-4187d8217260) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-974592635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7db3dd7554a09837f8d9c1f96079b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:25Z,use_quota=True,user_id='acdc0cc0eb654f9193d8ef3880a09ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7a55fd-6c17-42cb-8c45-de88e23cfb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c7a55fd-6c17-42cb-8c45-de88e23cfb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96267073-6fed-4840-a278-d1eaa5c4da94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (96267073-6fed-4840-a278-d1eaa5c4da94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8', 'volume_name': 'volume-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8bc0864-95db-4f11-bc97-28452933f4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8bc0864-95db-4f11-bc97-28452933f4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e084623-f00f-4304-aa44-7d5a245caf34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:25 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Volume 5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8', 'volume_size': 1} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-974592635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7db3dd7554a09837f8d9c1f96079b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:25Z,use_quota=True,user_id='acdc0cc0eb654f9193d8ef3880a09ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Creating volume 5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:23:25 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:25 devstack sudo[106393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8 1073741824 Jul 09 10:23:25 devstack sudo[106393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:25 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:23:25 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:26 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.914s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:26 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:23:26 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] Deleted volume successfully. Jul 09 10:23:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-da49c4e5-5000-40f0-9f24-c5b61755fa87 tempest-VolumeImageDependencyTests-588547797 None] Lock "cinder-59d9cc02-2888-4fbe-97fa-547a52a7e0f2-delete_volume" released by "delete_volume" :: held 4.788s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:26 devstack sudo[106393]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8 1073741824" returned: 0 in 1.094s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:26 devstack sudo[106401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8 Jul 09 10:23:26 devstack sudo[106401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:27 devstack sudo[106401]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8" returned: 0 in 0.688s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] <== create_volume: return (1837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.841s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e084623-f00f-4304-aa44-7d5a245caf34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8639c55f-ced8-486d-9ebc-42bf844f1bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:27 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Volume volume-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8 (5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8): created successfully Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8639c55f-ced8-486d-9ebc-42bf844f1bb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Flow 'volume_create_manager' (1394011e-95fa-49a3-871a-11306918efcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:27 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f9526e2c-5a59-4048-a1de-50b8e433ea0b tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Created volume successfully. Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Flow 'volume_create_manager' (0390a3ad-f7ec-4a4e-9f32-8dbb530514d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be285470-69ef-4db6-9cea-4b5b17dce5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be285470-69ef-4db6-9cea-4b5b17dce5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-333878017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456b899c-83a7-4550-8d66-d800af413944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e45afa1d49413bba0a11a3076da22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:28Z,use_quota=True,user_id='fb18678e0aa246e582adcee44fa2e7b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f307cbd-3874-4962-872a-723ac80e53dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0f307cbd-3874-4962-872a-723ac80e53dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41480e9b-6b50-4cf4-8bfc-a14e6bca2628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41480e9b-6b50-4cf4-8bfc-a14e6bca2628) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '456b899c-83a7-4550-8d66-d800af413944', 'volume_name': 'volume-456b899c-83a7-4550-8d66-d800af413944', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d761a120-48de-4d02-80bd-05f91c7ea8ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d761a120-48de-4d02-80bd-05f91c7ea8ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c505411-ebf8-4b33-82fa-89c16fa0f519) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:27 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Volume 456b899c-83a7-4550-8d66-d800af413944: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-456b899c-83a7-4550-8d66-d800af413944', 'volume_size': 1} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-333878017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=456b899c-83a7-4550-8d66-d800af413944,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e45afa1d49413bba0a11a3076da22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:28Z,use_quota=True,user_id='fb18678e0aa246e582adcee44fa2e7b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Creating volume 456b899c-83a7-4550-8d66-d800af413944 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:23:27 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:23:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:27 devstack sudo[106404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 1073741824 Jul 09 10:23:27 devstack sudo[106404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:28 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:23:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Flow 'volume_create_manager' (57cd43f7-5201-44c6-9178-3280948647ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a945a4-512f-49ef-bf90-93352c4b27ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98a945a4-512f-49ef-bf90-93352c4b27ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1745758093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7eef625-773c-4f86-8361-c68a344513ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7db3dd7554a09837f8d9c1f96079b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:28Z,use_quota=True,user_id='acdc0cc0eb654f9193d8ef3880a09ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f256a83-bf76-4304-ba24-3514836db5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f256a83-bf76-4304-ba24-3514836db5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d4efb0-a11d-422f-ae72-14b06cbff45a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d4efb0-a11d-422f-ae72-14b06cbff45a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7eef625-773c-4f86-8361-c68a344513ec', 'volume_name': 'volume-d7eef625-773c-4f86-8361-c68a344513ec', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6cae865-6e02-48bc-8584-9e3a00d0f7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6cae865-6e02-48bc-8584-9e3a00d0f7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d51531-214e-4e26-a773-a5cd09464c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:28 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Volume d7eef625-773c-4f86-8361-c68a344513ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7eef625-773c-4f86-8361-c68a344513ec', 'volume_size': 1} Jul 09 10:23:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:28 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:23:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Flow 'volume_create_manager' (4addde33-4599-4853-8e0d-00cdac5df361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef6dfc0-5613-4d8c-915a-af9a335e59df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ef6dfc0-5613-4d8c-915a-af9a335e59df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1936166796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7216bbe-ce05-4280-9b6d-d31299a9571f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7db3dd7554a09837f8d9c1f96079b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:29Z,use_quota=True,user_id='acdc0cc0eb654f9193d8ef3880a09ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b785b313-3ef1-49cd-91f2-9409a4a5bbd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b785b313-3ef1-49cd-91f2-9409a4a5bbd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1c0974-bfd5-4a69-9d45-3d4bb7182fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a1c0974-bfd5-4a69-9d45-3d4bb7182fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7216bbe-ce05-4280-9b6d-d31299a9571f', 'volume_name': 'volume-d7216bbe-ce05-4280-9b6d-d31299a9571f', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a4c0bd-4e00-4612-b437-3d14b1e8559a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83a4c0bd-4e00-4612-b437-3d14b1e8559a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb7dd08-512c-4a61-9cf5-f61c5dc92e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:29 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Volume d7216bbe-ce05-4280-9b6d-d31299a9571f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7216bbe-ce05-4280-9b6d-d31299a9571f', 'volume_size': 1} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:29 devstack sudo[106404]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 1073741824" returned: 0 in 1.365s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:29 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 Jul 09 10:23:29 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Flow 'volume_create_manager' (b8ea0aef-ad28-4b35-b641-b76a8d9dd9b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36924498-21b9-4c2d-a2a3-b4f08aca0e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36924498-21b9-4c2d-a2a3-b4f08aca0e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-962737637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f142392-cdb3-4328-b3c1-a0bffaa625bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7db3dd7554a09837f8d9c1f96079b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:29Z,use_quota=True,user_id='acdc0cc0eb654f9193d8ef3880a09ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0756c672-4585-44af-b024-a717db139c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0756c672-4585-44af-b024-a717db139c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71cb05b1-a597-4ad9-96fe-a7c2e3173211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71cb05b1-a597-4ad9-96fe-a7c2e3173211) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f142392-cdb3-4328-b3c1-a0bffaa625bc', 'volume_name': 'volume-5f142392-cdb3-4328-b3c1-a0bffaa625bc', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c581f9a4-0318-4a77-92be-5d2ce8fcf9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c581f9a4-0318-4a77-92be-5d2ce8fcf9a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be69686b-9ce6-4fd8-8fc0-3eb829800a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:29 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Volume 5f142392-cdb3-4328-b3c1-a0bffaa625bc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f142392-cdb3-4328-b3c1-a0bffaa625bc', 'volume_size': 1} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:29 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:23:29 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Flow 'volume_create_manager' (b6a0f99f-c974-43e5-beb8-661fb4901407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3a180e-512a-4ba8-861d-2bac5c595b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f3a180e-512a-4ba8-861d-2bac5c595b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-907285649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc6ebf7-ba8b-4d51-ac75-6e51390e5907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7db3dd7554a09837f8d9c1f96079b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:30Z,use_quota=True,user_id='acdc0cc0eb654f9193d8ef3880a09ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899f235f-6cb8-42b3-813b-97e6dc3c9309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899f235f-6cb8-42b3-813b-97e6dc3c9309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07828825-ec13-4c96-88c1-5ff899f7c453) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:30 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (07828825-ec13-4c96-88c1-5ff899f7c453) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'afc6ebf7-ba8b-4d51-ac75-6e51390e5907', 'volume_name': 'volume-afc6ebf7-ba8b-4d51-ac75-6e51390e5907', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f02850-de9b-4726-aeff-3e1d38d90759) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7f02850-de9b-4726-aeff-3e1d38d90759) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389aa2c5-40e7-4dd0-be1b-2f5e16f4d424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:30 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Volume afc6ebf7-ba8b-4d51-ac75-6e51390e5907: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-afc6ebf7-ba8b-4d51-ac75-6e51390e5907', 'volume_size': 1} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944" returned: 0 in 0.927s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] <== create_volume: return (2369ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.373s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.813s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1745758093',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7eef625-773c-4f86-8361-c68a344513ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7db3dd7554a09837f8d9c1f96079b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:28Z,use_quota=True,user_id='acdc0cc0eb654f9193d8ef3880a09ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Creating volume d7eef625-773c-4f86-8361-c68a344513ec {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:23:30 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7eef625-773c-4f86-8361-c68a344513ec 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c505411-ebf8-4b33-82fa-89c16fa0f519) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-456b899c-83a7-4550-8d66-d800af413944', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:30 devstack sudo[106416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7eef625-773c-4f86-8361-c68a344513ec 1073741824 Jul 09 10:23:30 devstack sudo[106416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5412151-fe65-4be1-b02d-bbb7bde8ad8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:30 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Volume volume-456b899c-83a7-4550-8d66-d800af413944 (456b899c-83a7-4550-8d66-d800af413944): created successfully Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5412151-fe65-4be1-b02d-bbb7bde8ad8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Flow 'volume_create_manager' (0390a3ad-f7ec-4a4e-9f32-8dbb530514d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-fc107de0-9568-4120-8811-8d42d6bef9f8 tempest-SnapshotDependencyTests-1477459490 None] Created volume successfully. Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Flow 'volume_create_manager' (11fd90c2-020b-4010-b6f6-d388159ce72c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edcdfbd3-d7a4-43b4-b2ae-c5732a06ace5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (edcdfbd3-d7a4-43b4-b2ae-c5732a06ace5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1817848413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc16ca0-0a94-4171-a200-687196d87c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7db3dd7554a09837f8d9c1f96079b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:30Z,use_quota=True,user_id='acdc0cc0eb654f9193d8ef3880a09ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0514b55e-d95e-47b7-9540-55d17c73f1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0514b55e-d95e-47b7-9540-55d17c73f1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bdf924b-fd17-4c5e-aa91-da4db6905ac5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9bdf924b-fd17-4c5e-aa91-da4db6905ac5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bc16ca0-0a94-4171-a200-687196d87c4f', 'volume_name': 'volume-7bc16ca0-0a94-4171-a200-687196d87c4f', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b3ef39-f5b1-4611-a06d-d27193bbd2db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b3ef39-f5b1-4611-a06d-d27193bbd2db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91688f17-c57c-4d1d-b930-842eabb9be4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:30 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Volume 7bc16ca0-0a94-4171-a200-687196d87c4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bc16ca0-0a94-4171-a200-687196d87c4f', 'volume_size': 1} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:30 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.008s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:23:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:23:31 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:23:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Flow 'volume_create_manager' (3da7a037-fba0-40ac-a49a-b5151ff346a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac12ef7b-12ff-430a-9f90-630db7eb86b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac12ef7b-12ff-430a-9f90-630db7eb86b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c7c752-b264-4564-90ef-bab74ffb1aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e184c00185421594412425efa73347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:31Z,use_quota=True,user_id='95f8fdb9afb7414e83cff7812e990dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eae2952-f28f-4f86-9e58-323a9f40e14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6eae2952-f28f-4f86-9e58-323a9f40e14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a6afc6-6203-43f4-94a9-8ea1549843fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9a6afc6-6203-43f4-94a9-8ea1549843fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75c7c752-b264-4564-90ef-bab74ffb1aaf', 'volume_name': 'volume-75c7c752-b264-4564-90ef-bab74ffb1aaf', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6806e27a-a50d-47be-b22a-9ca595739cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6806e27a-a50d-47be-b22a-9ca595739cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:31 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e431193f-89f4-4c71-8ae3-c871da8d0e77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:31 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Volume 75c7c752-b264-4564-90ef-bab74ffb1aaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75c7c752-b264-4564-90ef-bab74ffb1aaf', 'volume_size': 1} Jul 09 10:23:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:31 devstack sudo[106416]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6a823d19-9b6f-44d0-8bba-39be6bf8e5b0 tempest-SnapshotDependencyTests-1477459490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7eef625-773c-4f86-8361-c68a344513ec 1073741824" returned: 0 in 1.121s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7eef625-773c-4f86-8361-c68a344513ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:31 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7eef625-773c-4f86-8361-c68a344513ec Jul 09 10:23:31 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:32 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7eef625-773c-4f86-8361-c68a344513ec" returned: 0 in 0.711s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:23:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.980s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1936166796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7216bbe-ce05-4280-9b6d-d31299a9571f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7db3dd7554a09837f8d9c1f96079b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:29Z,use_quota=True,user_id='acdc0cc0eb654f9193d8ef3880a09ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:23:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Creating volume d7216bbe-ce05-4280-9b6d-d31299a9571f {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:23:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:23:32 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:23:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7216bbe-ce05-4280-9b6d-d31299a9571f 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:32 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7216bbe-ce05-4280-9b6d-d31299a9571f 1073741824 Jul 09 10:23:32 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65d51531-214e-4e26-a773-a5cd09464c0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7eef625-773c-4f86-8361-c68a344513ec', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9dd7996-8fd6-4789-b5d3-89232cc208dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:32 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Volume volume-d7eef625-773c-4f86-8361-c68a344513ec (d7eef625-773c-4f86-8361-c68a344513ec): created successfully Jul 09 10:23:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9dd7996-8fd6-4789-b5d3-89232cc208dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Flow 'volume_create_manager' (57cd43f7-5201-44c6-9178-3280948647ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:32 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3a23e1b1-5d67-4216-bcc7-1d5d4af2e58c tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Created volume successfully. Jul 09 10:23:33 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7216bbe-ce05-4280-9b6d-d31299a9571f 1073741824" returned: 0 in 0.907s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7216bbe-ce05-4280-9b6d-d31299a9571f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:33 devstack sudo[106434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7216bbe-ce05-4280-9b6d-d31299a9571f Jul 09 10:23:33 devstack sudo[106434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:33 devstack sudo[106434]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7216bbe-ce05-4280-9b6d-d31299a9571f" returned: 0 in 0.661s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] <== create_volume: return (1619ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:23:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.622s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.119s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-962737637',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f142392-cdb3-4328-b3c1-a0bffaa625bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7db3dd7554a09837f8d9c1f96079b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:29Z,use_quota=True,user_id='acdc0cc0eb654f9193d8ef3880a09ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:23:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Creating volume 5f142392-cdb3-4328-b3c1-a0bffaa625bc {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:23:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:23:33 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:23:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5f142392-cdb3-4328-b3c1-a0bffaa625bc 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb7dd08-512c-4a61-9cf5-f61c5dc92e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7216bbe-ce05-4280-9b6d-d31299a9571f', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:33 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5f142392-cdb3-4328-b3c1-a0bffaa625bc 1073741824 Jul 09 10:23:33 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989e18ce-c425-4e04-a60d-25352fc2b96c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:33 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Volume volume-d7216bbe-ce05-4280-9b6d-d31299a9571f (d7216bbe-ce05-4280-9b6d-d31299a9571f): created successfully Jul 09 10:23:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (989e18ce-c425-4e04-a60d-25352fc2b96c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:33 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Flow 'volume_create_manager' (4addde33-4599-4853-8e0d-00cdac5df361) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-87f3f3ce-b31d-4ab6-8ff1-90914aca55c4 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Created volume successfully. Jul 09 10:23:34 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5f142392-cdb3-4328-b3c1-a0bffaa625bc 1073741824" returned: 0 in 0.822s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5f142392-cdb3-4328-b3c1-a0bffaa625bc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:34 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5f142392-cdb3-4328-b3c1-a0bffaa625bc Jul 09 10:23:34 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:35 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5f142392-cdb3-4328-b3c1-a0bffaa625bc" returned: 0 in 0.680s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] <== create_volume: return (1546ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:23:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.548s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.071s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-907285649',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=afc6ebf7-ba8b-4d51-ac75-6e51390e5907,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7db3dd7554a09837f8d9c1f96079b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:30Z,use_quota=True,user_id='acdc0cc0eb654f9193d8ef3880a09ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:23:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Creating volume afc6ebf7-ba8b-4d51-ac75-6e51390e5907 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:23:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:23:35 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:23:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-afc6ebf7-ba8b-4d51-ac75-6e51390e5907 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be69686b-9ce6-4fd8-8fc0-3eb829800a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f142392-cdb3-4328-b3c1-a0bffaa625bc', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:35 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-afc6ebf7-ba8b-4d51-ac75-6e51390e5907 1073741824 Jul 09 10:23:35 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ead5eff-6f75-4944-806c-034f57c40c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:35 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Volume volume-5f142392-cdb3-4328-b3c1-a0bffaa625bc (5f142392-cdb3-4328-b3c1-a0bffaa625bc): created successfully Jul 09 10:23:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ead5eff-6f75-4944-806c-034f57c40c6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:35 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Flow 'volume_create_manager' (b8ea0aef-ad28-4b35-b641-b76a8d9dd9b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:35 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-42ed8b3c-3bb8-4545-a708-86bc9d1bf38e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Created volume successfully. Jul 09 10:23:36 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-afc6ebf7-ba8b-4d51-ac75-6e51390e5907 1073741824" returned: 0 in 0.929s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-afc6ebf7-ba8b-4d51-ac75-6e51390e5907 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:36 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-afc6ebf7-ba8b-4d51-ac75-6e51390e5907 Jul 09 10:23:36 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:36 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-afc6ebf7-ba8b-4d51-ac75-6e51390e5907" returned: 0 in 0.649s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:23:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.158s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1817848413',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bc16ca0-0a94-4171-a200-687196d87c4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9f7db3dd7554a09837f8d9c1f96079b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:30Z,use_quota=True,user_id='acdc0cc0eb654f9193d8ef3880a09ecb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:23:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Creating volume 7bc16ca0-0a94-4171-a200-687196d87c4f {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:23:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:23:36 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:23:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7bc16ca0-0a94-4171-a200-687196d87c4f 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:36 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7bc16ca0-0a94-4171-a200-687196d87c4f 1073741824 Jul 09 10:23:36 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (389aa2c5-40e7-4dd0-be1b-2f5e16f4d424) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-afc6ebf7-ba8b-4d51-ac75-6e51390e5907', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5aeebfe-343d-4334-ac2a-7d88997b3d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:36 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Volume volume-afc6ebf7-ba8b-4d51-ac75-6e51390e5907 (afc6ebf7-ba8b-4d51-ac75-6e51390e5907): created successfully Jul 09 10:23:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5aeebfe-343d-4334-ac2a-7d88997b3d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Flow 'volume_create_manager' (b6a0f99f-c974-43e5-beb8-661fb4901407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:36 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8d7d9568-7e3b-428c-a538-201d55953ea8 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Created volume successfully. Jul 09 10:23:37 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7bc16ca0-0a94-4171-a200-687196d87c4f 1073741824" returned: 0 in 0.801s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7bc16ca0-0a94-4171-a200-687196d87c4f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:37 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7bc16ca0-0a94-4171-a200-687196d87c4f Jul 09 10:23:37 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:38 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7bc16ca0-0a94-4171-a200-687196d87c4f" returned: 0 in 0.642s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:23:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.169s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75c7c752-b264-4564-90ef-bab74ffb1aaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e184c00185421594412425efa73347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:31Z,use_quota=True,user_id='95f8fdb9afb7414e83cff7812e990dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:23:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Creating volume 75c7c752-b264-4564-90ef-bab74ffb1aaf {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:23:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:23:38 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:23:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75c7c752-b264-4564-90ef-bab74ffb1aaf 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (91688f17-c57c-4d1d-b930-842eabb9be4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bc16ca0-0a94-4171-a200-687196d87c4f', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:38 devstack sudo[106499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75c7c752-b264-4564-90ef-bab74ffb1aaf 1073741824 Jul 09 10:23:38 devstack sudo[106499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3a2330-2b08-4835-8586-999248ff80a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:38 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Volume volume-7bc16ca0-0a94-4171-a200-687196d87c4f (7bc16ca0-0a94-4171-a200-687196d87c4f): created successfully Jul 09 10:23:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f3a2330-2b08-4835-8586-999248ff80a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Flow 'volume_create_manager' (11fd90c2-020b-4010-b6f6-d388159ce72c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:38 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7e518750-bd79-404c-9179-9ae9d5c11835 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Created volume successfully. Jul 09 10:23:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b2df9f2d-8765-4310-8744-31e44f9ad908 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "cinder-7bc16ca0-0a94-4171-a200-687196d87c4f-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b2df9f2d-8765-4310-8744-31e44f9ad908 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-7bc16ca0-0a94-4171-a200-687196d87c4f-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b2df9f2d-8765-4310-8744-31e44f9ad908 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "cinder-quobyte-7bc16ca0-0a94-4171-a200-687196d87c4f" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:39 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b2df9f2d-8765-4310-8744-31e44f9ad908 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-quobyte-7bc16ca0-0a94-4171-a200-687196d87c4f" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:39 devstack sudo[106499]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75c7c752-b264-4564-90ef-bab74ffb1aaf 1073741824" returned: 0 in 0.967s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:39 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a857c3-de84-490e-8e7a-76fcf9c83707]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b2df9f2d-8765-4310-8744-31e44f9ad908 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7bc16ca0-0a94-4171-a200-687196d87c4f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75c7c752-b264-4564-90ef-bab74ffb1aaf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:39 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75c7c752-b264-4564-90ef-bab74ffb1aaf Jul 09 10:23:39 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:39 devstack sudo[106505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7bc16ca0-0a94-4171-a200-687196d87c4f Jul 09 10:23:39 devstack sudo[106505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:40 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75c7c752-b264-4564-90ef-bab74ffb1aaf" returned: 0 in 0.689s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] <== create_volume: return (1726ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:23:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6a823d19-9b6f-44d0-8bba-39be6bf8e5b0 tempest-SnapshotDependencyTests-1477459490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.786s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e431193f-89f4-4c71-8ae3-c871da8d0e77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75c7c752-b264-4564-90ef-bab74ffb1aaf', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b30c5bc-61a0-4abd-8cf0-1695c51c5373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-6a823d19-9b6f-44d0-8bba-39be6bf8e5b0 tempest-SnapshotDependencyTests-1477459490 None] Creating offline snapshot 08fc633b-742e-46d9-9931-bf9935fd67f3 of volume 456b899c-83a7-4550-8d66-d800af413944 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:23:40 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Volume volume-75c7c752-b264-4564-90ef-bab74ffb1aaf (75c7c752-b264-4564-90ef-bab74ffb1aaf): created successfully Jul 09 10:23:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9b30c5bc-61a0-4abd-8cf0-1695c51c5373) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:40 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Flow 'volume_create_manager' (3da7a037-fba0-40ac-a49a-b5151ff346a6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:40 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[60241fb5-057e-4b79-9b7e-acf6fc772e86]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:40 devstack sudo[106505]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6a823d19-9b6f-44d0-8bba-39be6bf8e5b0 tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b2df9f2d-8765-4310-8744-31e44f9ad908 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7bc16ca0-0a94-4171-a200-687196d87c4f" returned: 0 in 0.854s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b2df9f2d-8765-4310-8744-31e44f9ad908 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7bc16ca0-0a94-4171-a200-687196d87c4f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:40 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-42c55f62-32c6-4bf1-a8c1-8e6493a7df9c tempest-CinderUnicodeTest-1578535637 None] Created volume successfully. Jul 09 10:23:40 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7bc16ca0-0a94-4171-a200-687196d87c4f Jul 09 10:23:40 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:40 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 Jul 09 10:23:40 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:41 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b2df9f2d-8765-4310-8744-31e44f9ad908 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7bc16ca0-0a94-4171-a200-687196d87c4f" returned: 0 in 0.847s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b2df9f2d-8765-4310-8744-31e44f9ad908 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-quobyte-7bc16ca0-0a94-4171-a200-687196d87c4f" released by "delete_volume" :: held 1.768s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:41 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6a823d19-9b6f-44d0-8bba-39be6bf8e5b0 tempest-SnapshotDependencyTests-1477459490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944" returned: 0 in 0.914s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6a823d19-9b6f-44d0-8bba-39be6bf8e5b0 tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:41 devstack sudo[106521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3 1G Jul 09 10:23:41 devstack sudo[106521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-b2df9f2d-8765-4310-8744-31e44f9ad908 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Created reservations ['45256b4d-e90d-4e1c-a9d6-dff44cb36373', 'a57cba17-07fa-41a3-a729-cf38ca1f4b2f', 'b8dec345-d6ba-454e-8a81-009a9371b086', 'd8570279-7482-4562-a5e7-a4fe4e0a17a4'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Flow 'volume_create_manager' (7805e5e9-3d33-4a48-8241-b79d5deeb443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24cb08d5-b876-4e0a-888a-42cb4ee709d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24cb08d5-b876-4e0a-888a-42cb4ee709d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-283854123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301b7d4a-5243-4979-82ce-4cb4350407ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e184c00185421594412425efa73347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:41Z,use_quota=True,user_id='95f8fdb9afb7414e83cff7812e990dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c1672d-bc6e-4fa9-a718-acfc8fb9ebf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08c1672d-bc6e-4fa9-a718-acfc8fb9ebf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b789bcd-3f62-4854-8152-56bcf9c951c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b789bcd-3f62-4854-8152-56bcf9c951c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '301b7d4a-5243-4979-82ce-4cb4350407ec', 'volume_name': 'volume-301b7d4a-5243-4979-82ce-4cb4350407ec', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d737287-fc61-41bb-9e18-a5c8ade34309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d737287-fc61-41bb-9e18-a5c8ade34309) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67e2bb3-774b-4b55-a405-0bc9f2446d4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:41 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Volume 301b7d4a-5243-4979-82ce-4cb4350407ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-301b7d4a-5243-4979-82ce-4cb4350407ec', 'volume_size': 1} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b2df9f2d-8765-4310-8744-31e44f9ad908 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b2df9f2d-8765-4310-8744-31e44f9ad908 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b2df9f2d-8765-4310-8744-31e44f9ad908 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b2df9f2d-8765-4310-8744-31e44f9ad908 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b2df9f2d-8765-4310-8744-31e44f9ad908 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b2df9f2d-8765-4310-8744-31e44f9ad908 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:41 devstack sudo[106523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:23:41 devstack sudo[106523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-35253290-4f6f-43d6-9e83-e5ff0c0b6f0d tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "cinder-afc6ebf7-ba8b-4d51-ac75-6e51390e5907-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-35253290-4f6f-43d6-9e83-e5ff0c0b6f0d tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-afc6ebf7-ba8b-4d51-ac75-6e51390e5907-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-35253290-4f6f-43d6-9e83-e5ff0c0b6f0d tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "cinder-quobyte-afc6ebf7-ba8b-4d51-ac75-6e51390e5907" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-35253290-4f6f-43d6-9e83-e5ff0c0b6f0d tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-quobyte-afc6ebf7-ba8b-4d51-ac75-6e51390e5907" acquired by "delete_volume" :: waited 0.034s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[379b4fb2-4680-49a4-8326-8fcd4ab8094b]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-35253290-4f6f-43d6-9e83-e5ff0c0b6f0d tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-afc6ebf7-ba8b-4d51-ac75-6e51390e5907 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:41 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-afc6ebf7-ba8b-4d51-ac75-6e51390e5907 Jul 09 10:23:41 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:42 devstack sudo[106521]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6a823d19-9b6f-44d0-8bba-39be6bf8e5b0 tempest-SnapshotDependencyTests-1477459490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3 1G" returned: 0 in 0.936s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6a823d19-9b6f-44d0-8bba-39be6bf8e5b0 tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456b899c-83a7-4550-8d66-d800af413944 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:42 devstack sudo[106532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456b899c-83a7-4550-8d66-d800af413944 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3 Jul 09 10:23:42 devstack sudo[106532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:42 devstack sudo[106523]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b2df9f2d-8765-4310-8744-31e44f9ad908 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.780s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:42 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-b2df9f2d-8765-4310-8744-31e44f9ad908 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:23:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b2df9f2d-8765-4310-8744-31e44f9ad908 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Deleted volume successfully. Jul 09 10:23:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b2df9f2d-8765-4310-8744-31e44f9ad908 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-7bc16ca0-0a94-4171-a200-687196d87c4f-delete_volume" released by "delete_volume" :: held 2.895s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:42 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-35253290-4f6f-43d6-9e83-e5ff0c0b6f0d tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-afc6ebf7-ba8b-4d51-ac75-6e51390e5907" returned: 0 in 0.795s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-35253290-4f6f-43d6-9e83-e5ff0c0b6f0d tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-afc6ebf7-ba8b-4d51-ac75-6e51390e5907 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:42 devstack sudo[106537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-afc6ebf7-ba8b-4d51-ac75-6e51390e5907 Jul 09 10:23:42 devstack sudo[106537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:42 devstack sudo[106532]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6a823d19-9b6f-44d0-8bba-39be6bf8e5b0 tempest-SnapshotDependencyTests-1477459490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-456b899c-83a7-4550-8d66-d800af413944 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3" returned: 0 in 0.690s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:42 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-6a823d19-9b6f-44d0-8bba-39be6bf8e5b0 tempest-SnapshotDependencyTests-1477459490 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3 is being set with open permissions: ugo+rw Jul 09 10:23:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6a823d19-9b6f-44d0-8bba-39be6bf8e5b0 tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:42 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3 Jul 09 10:23:42 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:43 devstack sudo[106537]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-35253290-4f6f-43d6-9e83-e5ff0c0b6f0d tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-afc6ebf7-ba8b-4d51-ac75-6e51390e5907" returned: 0 in 0.733s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-35253290-4f6f-43d6-9e83-e5ff0c0b6f0d tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-quobyte-afc6ebf7-ba8b-4d51-ac75-6e51390e5907" released by "delete_volume" :: held 1.583s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:43 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-35253290-4f6f-43d6-9e83-e5ff0c0b6f0d tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Created reservations ['77b5af5e-64db-434a-9555-4a55494de6d5', 'a9d6d0c7-b1e8-46b8-8bf4-ec04dad763c4', 'c241fba0-4cdb-4b9a-99d2-4f23b9d19975', '321fa0a0-3783-4cec-9ad9-eb1f808d6178'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:23:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-35253290-4f6f-43d6-9e83-e5ff0c0b6f0d tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-35253290-4f6f-43d6-9e83-e5ff0c0b6f0d tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-35253290-4f6f-43d6-9e83-e5ff0c0b6f0d tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-35253290-4f6f-43d6-9e83-e5ff0c0b6f0d tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-35253290-4f6f-43d6-9e83-e5ff0c0b6f0d tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-35253290-4f6f-43d6-9e83-e5ff0c0b6f0d tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:43 devstack sudo[106553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:23:43 devstack sudo[106553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:43 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6a823d19-9b6f-44d0-8bba-39be6bf8e5b0 tempest-SnapshotDependencyTests-1477459490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3" returned: 0 in 0.728s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6a823d19-9b6f-44d0-8bba-39be6bf8e5b0 tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:43 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.info Jul 09 10:23:43 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0214dd0e-1008-4c4e-b045-84cde3e902ad tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "cinder-5f142392-cdb3-4328-b3c1-a0bffaa625bc-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0214dd0e-1008-4c4e-b045-84cde3e902ad tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-5f142392-cdb3-4328-b3c1-a0bffaa625bc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0214dd0e-1008-4c4e-b045-84cde3e902ad tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "cinder-quobyte-5f142392-cdb3-4328-b3c1-a0bffaa625bc" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0214dd0e-1008-4c4e-b045-84cde3e902ad tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-quobyte-5f142392-cdb3-4328-b3c1-a0bffaa625bc" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:43 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[79fbdd43-578e-4032-a9a2-8d16b02310a5]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0214dd0e-1008-4c4e-b045-84cde3e902ad tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5f142392-cdb3-4328-b3c1-a0bffaa625bc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:44 devstack sudo[106557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5f142392-cdb3-4328-b3c1-a0bffaa625bc Jul 09 10:23:44 devstack sudo[106557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:44 devstack sudo[106553]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-35253290-4f6f-43d6-9e83-e5ff0c0b6f0d tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.785s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:44 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-35253290-4f6f-43d6-9e83-e5ff0c0b6f0d tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:23:44 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-35253290-4f6f-43d6-9e83-e5ff0c0b6f0d tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Deleted volume successfully. Jul 09 10:23:44 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-35253290-4f6f-43d6-9e83-e5ff0c0b6f0d tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-afc6ebf7-ba8b-4d51-ac75-6e51390e5907-delete_volume" released by "delete_volume" :: held 2.635s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:44 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6a823d19-9b6f-44d0-8bba-39be6bf8e5b0 tempest-SnapshotDependencyTests-1477459490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.info" returned: 0 in 0.802s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:44 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-6a823d19-9b6f-44d0-8bba-39be6bf8e5b0 tempest-SnapshotDependencyTests-1477459490 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.info is being set with open permissions: ugo+rw Jul 09 10:23:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6a823d19-9b6f-44d0-8bba-39be6bf8e5b0 tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:44 devstack sudo[106561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.info Jul 09 10:23:44 devstack sudo[106561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:44 devstack sudo[106557]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0214dd0e-1008-4c4e-b045-84cde3e902ad tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5f142392-cdb3-4328-b3c1-a0bffaa625bc" returned: 0 in 0.767s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0214dd0e-1008-4c4e-b045-84cde3e902ad tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5f142392-cdb3-4328-b3c1-a0bffaa625bc {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:44 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5f142392-cdb3-4328-b3c1-a0bffaa625bc Jul 09 10:23:44 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:44 devstack sudo[106561]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6a823d19-9b6f-44d0-8bba-39be6bf8e5b0 tempest-SnapshotDependencyTests-1477459490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.info" returned: 0 in 0.649s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6a823d19-9b6f-44d0-8bba-39be6bf8e5b0 tempest-SnapshotDependencyTests-1477459490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.878s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.656s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:41Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-283854123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=301b7d4a-5243-4979-82ce-4cb4350407ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01e184c00185421594412425efa73347',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:41Z,use_quota=True,user_id='95f8fdb9afb7414e83cff7812e990dae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:23:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Creating volume 301b7d4a-5243-4979-82ce-4cb4350407ec {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:23:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:23:45 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:23:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:45 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec 1073741824 Jul 09 10:23:45 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:45 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6a823d19-9b6f-44d0-8bba-39be6bf8e5b0 tempest-SnapshotDependencyTests-1477459490 None] Create snapshot completed successfully Jul 09 10:23:45 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0214dd0e-1008-4c4e-b045-84cde3e902ad tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5f142392-cdb3-4328-b3c1-a0bffaa625bc" returned: 0 in 0.705s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:45 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0214dd0e-1008-4c4e-b045-84cde3e902ad tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-quobyte-5f142392-cdb3-4328-b3c1-a0bffaa625bc" released by "delete_volume" :: held 1.537s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:45 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-0214dd0e-1008-4c4e-b045-84cde3e902ad tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Created reservations ['990ab9e1-c2de-4f69-8762-f8521296cb15', '7a717fd7-01a5-4eac-84da-b6a4b06ce607', '80fd7f1b-c54c-4e1e-a1e3-3cb2e0cc341c', '58274125-368b-41fe-b079-890ddf986921'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:23:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0214dd0e-1008-4c4e-b045-84cde3e902ad tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0214dd0e-1008-4c4e-b045-84cde3e902ad tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0214dd0e-1008-4c4e-b045-84cde3e902ad tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0214dd0e-1008-4c4e-b045-84cde3e902ad tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0214dd0e-1008-4c4e-b045-84cde3e902ad tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0214dd0e-1008-4c4e-b045-84cde3e902ad tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:45 devstack sudo[106573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:23:45 devstack sudo[106573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:45 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec 1073741824" returned: 0 in 0.950s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:46 devstack sudo[106579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec Jul 09 10:23:46 devstack sudo[106579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff7d9914-e590-4d49-8bb9-74fdcfeba7f7 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "cinder-d7216bbe-ce05-4280-9b6d-d31299a9571f-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff7d9914-e590-4d49-8bb9-74fdcfeba7f7 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-d7216bbe-ce05-4280-9b6d-d31299a9571f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff7d9914-e590-4d49-8bb9-74fdcfeba7f7 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "cinder-quobyte-d7216bbe-ce05-4280-9b6d-d31299a9571f" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff7d9914-e590-4d49-8bb9-74fdcfeba7f7 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-quobyte-d7216bbe-ce05-4280-9b6d-d31299a9571f" acquired by "delete_volume" :: waited 0.040s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:46 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[76b21c78-5151-481f-9da7-2f7cdfa00c84]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff7d9914-e590-4d49-8bb9-74fdcfeba7f7 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7216bbe-ce05-4280-9b6d-d31299a9571f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:46 devstack sudo[106573]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0214dd0e-1008-4c4e-b045-84cde3e902ad tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.873s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:46 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-0214dd0e-1008-4c4e-b045-84cde3e902ad tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:23:46 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0214dd0e-1008-4c4e-b045-84cde3e902ad tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Deleted volume successfully. Jul 09 10:23:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0214dd0e-1008-4c4e-b045-84cde3e902ad tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-5f142392-cdb3-4328-b3c1-a0bffaa625bc-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:46 devstack sudo[106582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7216bbe-ce05-4280-9b6d-d31299a9571f Jul 09 10:23:46 devstack sudo[106582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:46 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Flow 'volume_create_manager' (0eb26323-f5f7-4dfc-b1ce-9900faa6d0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82045bb-8281-4270-8c07-c4cd4b2a32d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e82045bb-8281-4270-8c07-c4cd4b2a32d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:46Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40f0a55c-c911-49a1-8482-6f8392656912,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='75e45afa1d49413bba0a11a3076da22c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=08fc633b-742e-46d9-9931-bf9935fd67f3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:47Z,use_quota=True,user_id='fb18678e0aa246e582adcee44fa2e7b9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba12622-3b7c-4017-aa38-e6bd36e595aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba12622-3b7c-4017-aa38-e6bd36e595aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca91de4-0771-442f-b42c-ef3494846fa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bca91de4-0771-442f-b42c-ef3494846fa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '40f0a55c-c911-49a1-8482-6f8392656912', 'volume_name': 'volume-40f0a55c-c911-49a1-8482-6f8392656912', 'volume_size': 1, 'snapshot_id': '08fc633b-742e-46d9-9931-bf9935fd67f3'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:47 devstack sudo[106579]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca3415f-6b83-425a-889b-878845d1cad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ca3415f-6b83-425a-889b-878845d1cad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3495a40-1918-4c81-a570-203879ab8ae8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:47 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Volume 40f0a55c-c911-49a1-8482-6f8392656912: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-40f0a55c-c911-49a1-8482-6f8392656912', 'volume_size': 1, 'snapshot_id': '08fc633b-742e-46d9-9931-bf9935fd67f3'} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec" returned: 0 in 1.080s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] <== create_volume: return (2082ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.086s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Acquiring lock "cinder-quobyte-08fc633b-742e-46d9-9931-bf9935fd67f3-40f0a55c-c911-49a1-8482-6f8392656912" by "_create_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f67e2bb3-774b-4b55-a405-0bc9f2446d4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-301b7d4a-5243-4979-82ce-4cb4350407ec', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a4393d-66b0-4d85-9095-19ff829eeb5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Lock "cinder-quobyte-08fc633b-742e-46d9-9931-bf9935fd67f3-40f0a55c-c911-49a1-8482-6f8392656912" acquired by "_create_volume_from_snapshot" :: waited 0.040s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Creating volume 40f0a55c-c911-49a1-8482-6f8392656912 from snapshot 08fc633b-742e-46d9-9931-bf9935fd67f3 {{(pid=87192) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Acquiring lock "cinder-quobyte-40f0a55c-c911-49a1-8482-6f8392656912" by "_copy_volume_from_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:47 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Volume volume-301b7d4a-5243-4979-82ce-4cb4350407ec (301b7d4a-5243-4979-82ce-4cb4350407ec): created successfully Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f9a4393d-66b0-4d85-9095-19ff829eeb5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Flow 'volume_create_manager' (7805e5e9-3d33-4a48-8241-b79d5deeb443) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Lock "cinder-quobyte-40f0a55c-c911-49a1-8482-6f8392656912" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] snapshot: 08fc633b-742e-46d9-9931-bf9935fd67f3, volume: 40f0a55c-c911-49a1-8482-6f8392656912, {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 09 10:23:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-72896f26-4742-4019-b2cc-93e4334e5dd0 tempest-CinderUnicodeTest-1578535637 None] Created volume successfully. Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[90cfd59e-b16a-43c5-8a5c-7648fb5ce993]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:47 devstack sudo[106582]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff7d9914-e590-4d49-8bb9-74fdcfeba7f7 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7216bbe-ce05-4280-9b6d-d31299a9571f" returned: 0 in 1.102s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff7d9914-e590-4d49-8bb9-74fdcfeba7f7 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7216bbe-ce05-4280-9b6d-d31299a9571f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:47 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3 Jul 09 10:23:47 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:47 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7216bbe-ce05-4280-9b6d-d31299a9571f Jul 09 10:23:47 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e676efa2-2b9c-4ee5-8dab-f0b68bc414ab tempest-CinderUnicodeTest-1578535637 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:48 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff7d9914-e590-4d49-8bb9-74fdcfeba7f7 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7216bbe-ce05-4280-9b6d-d31299a9571f" returned: 0 in 0.805s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:48 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3" returned: 0 in 0.931s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-456b899c-83a7-4550-8d66-d800af413944(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] will copy from snapshot at /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Creating direct copy from snapshot {{(pid=87192) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff7d9914-e590-4d49-8bb9-74fdcfeba7f7 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-quobyte-d7216bbe-ce05-4280-9b6d-d31299a9571f" released by "delete_volume" :: held 1.977s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0905c369-85f3-41a0-a5ee-59492192fc77]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ff7d9914-e590-4d49-8bb9-74fdcfeba7f7 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Created reservations ['669c6943-2ddf-4e07-98bd-b178f884c7d6', '4831d8a1-78d7-4282-bab2-659568db9d5e', '11459c05-2f16-49a9-9012-0904759ece5a', 'fe4e4039-ccb9-4b85-9b4d-436b2d997f81'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:23:48 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 Jul 09 10:23:48 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ff7d9914-e590-4d49-8bb9-74fdcfeba7f7 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ff7d9914-e590-4d49-8bb9-74fdcfeba7f7 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ff7d9914-e590-4d49-8bb9-74fdcfeba7f7 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ff7d9914-e590-4d49-8bb9-74fdcfeba7f7 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ff7d9914-e590-4d49-8bb9-74fdcfeba7f7 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff7d9914-e590-4d49-8bb9-74fdcfeba7f7 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:48 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:23:48 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9b4010e9-c7d4-4314-9902-3dd2457bc36f tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "cinder-d7eef625-773c-4f86-8361-c68a344513ec-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9b4010e9-c7d4-4314-9902-3dd2457bc36f tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-d7eef625-773c-4f86-8361-c68a344513ec-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9b4010e9-c7d4-4314-9902-3dd2457bc36f tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "cinder-quobyte-d7eef625-773c-4f86-8361-c68a344513ec" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9b4010e9-c7d4-4314-9902-3dd2457bc36f tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-quobyte-d7eef625-773c-4f86-8361-c68a344513ec" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[02022467-3d4b-44b7-95d5-0cc9a083b849]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9b4010e9-c7d4-4314-9902-3dd2457bc36f tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7eef625-773c-4f86-8361-c68a344513ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:48 devstack sudo[106601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7eef625-773c-4f86-8361-c68a344513ec Jul 09 10:23:48 devstack sudo[106601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:49 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff7d9914-e590-4d49-8bb9-74fdcfeba7f7 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.767s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:49 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-ff7d9914-e590-4d49-8bb9-74fdcfeba7f7 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:23:49 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ff7d9914-e590-4d49-8bb9-74fdcfeba7f7 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Deleted volume successfully. Jul 09 10:23:49 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff7d9914-e590-4d49-8bb9-74fdcfeba7f7 tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-d7216bbe-ce05-4280-9b6d-d31299a9571f-delete_volume" released by "delete_volume" :: held 3.055s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944" returned: 0 in 0.954s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:49 devstack cinder-volume[87192]: DEBUG cinder.utils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Path /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40f0a55c-c911-49a1-8482-6f8392656912 not found in is_blk_device check {{(pid=87192) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 09 10:23:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40f0a55c-c911-49a1-8482-6f8392656912 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:49 devstack sudo[106608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40f0a55c-c911-49a1-8482-6f8392656912 Jul 09 10:23:49 devstack sudo[106608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:49 devstack sudo[106601]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9b4010e9-c7d4-4314-9902-3dd2457bc36f tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7eef625-773c-4f86-8361-c68a344513ec" returned: 0 in 0.906s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9b4010e9-c7d4-4314-9902-3dd2457bc36f tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7eef625-773c-4f86-8361-c68a344513ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:49 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7eef625-773c-4f86-8361-c68a344513ec Jul 09 10:23:49 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:50 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:23:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Flow 'volume_create_manager' (33754c8f-6ecb-4ca8-ab71-83c67cb33e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb15f43-4326-4a70-8022-1a4ddf9c65f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb15f43-4326-4a70-8022-1a4ddf9c65f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2051895824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7835d27-8949-4187-8913-5fbdf57db5ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6cb952d36274d9ebd3768f8b096727d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:50Z,use_quota=True,user_id='9dbf0a948faa44f7bd93bc2a9664fa94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b692377c-8acb-4026-89ad-4bb479c78670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b692377c-8acb-4026-89ad-4bb479c78670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8f0536-a354-4ec0-9516-6c99876b0d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c8f0536-a354-4ec0-9516-6c99876b0d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7835d27-8949-4187-8913-5fbdf57db5ec', 'volume_name': 'volume-a7835d27-8949-4187-8913-5fbdf57db5ec', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89325360-de7a-4bae-9f19-01ab407947e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89325360-de7a-4bae-9f19-01ab407947e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9147e044-e98b-467e-a24f-cb843264ae9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:50 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Volume a7835d27-8949-4187-8913-5fbdf57db5ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7835d27-8949-4187-8913-5fbdf57db5ec', 'volume_size': 1} Jul 09 10:23:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:50 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9b4010e9-c7d4-4314-9902-3dd2457bc36f tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d7eef625-773c-4f86-8361-c68a344513ec" returned: 0 in 1.174s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9b4010e9-c7d4-4314-9902-3dd2457bc36f tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-quobyte-d7eef625-773c-4f86-8361-c68a344513ec" released by "delete_volume" :: held 2.152s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:50 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-9b4010e9-c7d4-4314-9902-3dd2457bc36f tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Created reservations ['5e0b3b3b-551d-4519-8cb5-7b39da9402dc', 'b54cb45e-b898-4e60-ad4d-8ca9a4feecfb', '999571e3-061b-4b41-8722-38a025c01ee3', '6e24f90f-9a57-426e-8966-93878d491f57'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:23:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9b4010e9-c7d4-4314-9902-3dd2457bc36f tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9b4010e9-c7d4-4314-9902-3dd2457bc36f tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9b4010e9-c7d4-4314-9902-3dd2457bc36f tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9b4010e9-c7d4-4314-9902-3dd2457bc36f tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9b4010e9-c7d4-4314-9902-3dd2457bc36f tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9b4010e9-c7d4-4314-9902-3dd2457bc36f tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:51 devstack sudo[106627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:23:51 devstack sudo[106627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-23027c93-9ac8-4f43-845a-ac3b6e9b089e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "cinder-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-23027c93-9ac8-4f43-845a-ac3b6e9b089e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-23027c93-9ac8-4f43-845a-ac3b6e9b089e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "cinder-quobyte-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-23027c93-9ac8-4f43-845a-ac3b6e9b089e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-quobyte-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8" acquired by "delete_volume" :: waited 0.038s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:52 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[40129fdd-f987-4415-a71f-432be98a2e28]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-23027c93-9ac8-4f43-845a-ac3b6e9b089e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:52 devstack sudo[106627]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9b4010e9-c7d4-4314-9902-3dd2457bc36f tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.306s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:52 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-9b4010e9-c7d4-4314-9902-3dd2457bc36f tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:23:52 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9b4010e9-c7d4-4314-9902-3dd2457bc36f tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Deleted volume successfully. Jul 09 10:23:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9b4010e9-c7d4-4314-9902-3dd2457bc36f tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-d7eef625-773c-4f86-8361-c68a344513ec-delete_volume" released by "delete_volume" :: held 3.898s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:52 devstack sudo[106631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8 Jul 09 10:23:52 devstack sudo[106631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:53 devstack sudo[106631]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-23027c93-9ac8-4f43-845a-ac3b6e9b089e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8" returned: 0 in 1.644s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-23027c93-9ac8-4f43-845a-ac3b6e9b089e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:54 devstack sudo[106636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8 Jul 09 10:23:54 devstack sudo[106636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:54 devstack sudo[106608]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40f0a55c-c911-49a1-8482-6f8392656912" returned: 0 in 5.022s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:54 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c278a8ab-a0d3-40b8-87dd-aa95042e5756]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:54 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 Jul 09 10:23:54 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:54 devstack sudo[106636]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-23027c93-9ac8-4f43-845a-ac3b6e9b089e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8" returned: 0 in 0.742s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-23027c93-9ac8-4f43-845a-ac3b6e9b089e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-quobyte-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8" released by "delete_volume" :: held 2.472s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:54 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-23027c93-9ac8-4f43-845a-ac3b6e9b089e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Created reservations ['232be78c-5a31-4d49-bd84-cb2279063c7a', '306a208d-f5c8-46c6-8cb4-5dbab20ef75b', '3c5c8e7e-81d6-40fa-98ab-d42486cee093', '3b881280-9886-4266-95a3-f5763f980c3f'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:23:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-23027c93-9ac8-4f43-845a-ac3b6e9b089e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:23:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-23027c93-9ac8-4f43-845a-ac3b6e9b089e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-23027c93-9ac8-4f43-845a-ac3b6e9b089e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:23:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-23027c93-9ac8-4f43-845a-ac3b6e9b089e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:23:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-23027c93-9ac8-4f43-845a-ac3b6e9b089e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-23027c93-9ac8-4f43-845a-ac3b6e9b089e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:54 devstack sudo[106641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:23:54 devstack sudo[106641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:55 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944" returned: 0 in 0.933s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:55 devstack cinder-volume[87192]: DEBUG cinder.image.image_utils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Image conversion details: src /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944, size 1024.00 MB, duration 5.02 sec, destination /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40f0a55c-c911-49a1-8482-6f8392656912 {{(pid=87192) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 09 10:23:55 devstack cinder-volume[87192]: INFO cinder.image.image_utils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Converted 1024.00 MB image at 203.86 MB/s Jul 09 10:23:55 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40f0a55c-c911-49a1-8482-6f8392656912 is being set with open permissions: ugo+rw Jul 09 10:23:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40f0a55c-c911-49a1-8482-6f8392656912 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:55 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40f0a55c-c911-49a1-8482-6f8392656912 Jul 09 10:23:55 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:55 devstack sudo[106641]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-23027c93-9ac8-4f43-845a-ac3b6e9b089e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.688s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:55 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-23027c93-9ac8-4f43-845a-ac3b6e9b089e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:23:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-23027c93-9ac8-4f43-845a-ac3b6e9b089e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Deleted volume successfully. Jul 09 10:23:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-23027c93-9ac8-4f43-845a-ac3b6e9b089e tempest-CreateVolumesFromSourceVolumeTest-1179355342 None] Lock "cinder-5bf97eba-7dc5-4fbf-b97f-6da2fb0475c8-delete_volume" released by "delete_volume" :: held 3.470s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:55 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40f0a55c-c911-49a1-8482-6f8392656912" returned: 0 in 0.651s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Lock "cinder-quobyte-40f0a55c-c911-49a1-8482-6f8392656912" released by "_copy_volume_from_snapshot" :: held 8.667s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Lock "cinder-quobyte-08fc633b-742e-46d9-9931-bf9935fd67f3-40f0a55c-c911-49a1-8482-6f8392656912" released by "_create_volume_from_snapshot" :: held 8.732s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:23:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.773s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:23:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e676efa2-2b9c-4ee5-8dab-f0b68bc414ab tempest-CinderUnicodeTest-1578535637 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.877s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:23:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e676efa2-2b9c-4ee5-8dab-f0b68bc414ab tempest-CinderUnicodeTest-1578535637 None] Creating offline snapshot e61c6512-bc1f-4511-b8da-c4489df6a51b of volume 301b7d4a-5243-4979-82ce-4cb4350407ec {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:23:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3495a40-1918-4c81-a570-203879ab8ae8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40f0a55c-c911-49a1-8482-6f8392656912', 'volume_size': 1, 'snapshot_id': '08fc633b-742e-46d9-9931-bf9935fd67f3'}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03cb106a-50d1-4829-b41d-c703bc04426f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:23:55 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4547a36c-033e-45aa-8752-2646da1b14f7]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e676efa2-2b9c-4ee5-8dab-f0b68bc414ab tempest-CinderUnicodeTest-1578535637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:55 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Volume volume-40f0a55c-c911-49a1-8482-6f8392656912 (40f0a55c-c911-49a1-8482-6f8392656912): created successfully Jul 09 10:23:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03cb106a-50d1-4829-b41d-c703bc04426f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:23:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Flow 'volume_create_manager' (0eb26323-f5f7-4dfc-b1ce-9900faa6d0fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:23:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-60460656-9959-4555-9bf8-7cf9cdc84998 tempest-SnapshotDependencyTests-1477459490 None] Created volume successfully. Jul 09 10:23:56 devstack sudo[106650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec Jul 09 10:23:56 devstack sudo[106650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:56 devstack sudo[106650]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e676efa2-2b9c-4ee5-8dab-f0b68bc414ab tempest-CinderUnicodeTest-1578535637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec" returned: 0 in 0.853s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e676efa2-2b9c-4ee5-8dab-f0b68bc414ab tempest-CinderUnicodeTest-1578535637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.e61c6512-bc1f-4511-b8da-c4489df6a51b 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:56 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.e61c6512-bc1f-4511-b8da-c4489df6a51b 1G Jul 09 10:23:56 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] Acquiring lock "cinder-08fc633b-742e-46d9-9931-bf9935fd67f3-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] Lock "cinder-08fc633b-742e-46d9-9931-bf9935fd67f3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] Acquiring lock "cinder-quobyte-456b899c-83a7-4550-8d66-d800af413944" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] Lock "cinder-quobyte-456b899c-83a7-4550-8d66-d800af413944" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] Acquiring lock "cinder-quobyte-08fc633b-742e-46d9-9931-bf9935fd67f3" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:23:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] Lock "cinder-quobyte-08fc633b-742e-46d9-9931-bf9935fd67f3" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:23:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] Deleting offline snapshot 08fc633b-742e-46d9-9931-bf9935fd67f3 of volume 456b899c-83a7-4550-8d66-d800af413944 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:23:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] snapshot_file for this snap is: volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:23:57 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2d708a7-9d32-4227-8b85-a7bce99da6d9]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:57 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3 Jul 09 10:23:57 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:57 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e676efa2-2b9c-4ee5-8dab-f0b68bc414ab tempest-CinderUnicodeTest-1578535637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.e61c6512-bc1f-4511-b8da-c4489df6a51b 1G" returned: 0 in 0.843s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e676efa2-2b9c-4ee5-8dab-f0b68bc414ab tempest-CinderUnicodeTest-1578535637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301b7d4a-5243-4979-82ce-4cb4350407ec -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.e61c6512-bc1f-4511-b8da-c4489df6a51b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:57 devstack sudo[106664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301b7d4a-5243-4979-82ce-4cb4350407ec -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.e61c6512-bc1f-4511-b8da-c4489df6a51b Jul 09 10:23:57 devstack sudo[106664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:57 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3" returned: 0 in 0.808s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-456b899c-83a7-4550-8d66-d800af413944(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:23:57 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[776901bc-b6ff-46dd-b222-ae4279689241]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:23:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:58 devstack sudo[106669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 Jul 09 10:23:58 devstack sudo[106669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:58 devstack sudo[106664]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e676efa2-2b9c-4ee5-8dab-f0b68bc414ab tempest-CinderUnicodeTest-1578535637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-301b7d4a-5243-4979-82ce-4cb4350407ec -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.e61c6512-bc1f-4511-b8da-c4489df6a51b" returned: 0 in 0.725s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:58 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-e676efa2-2b9c-4ee5-8dab-f0b68bc414ab tempest-CinderUnicodeTest-1578535637 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.e61c6512-bc1f-4511-b8da-c4489df6a51b is being set with open permissions: ugo+rw Jul 09 10:23:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e676efa2-2b9c-4ee5-8dab-f0b68bc414ab tempest-CinderUnicodeTest-1578535637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.e61c6512-bc1f-4511-b8da-c4489df6a51b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:58 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.e61c6512-bc1f-4511-b8da-c4489df6a51b Jul 09 10:23:58 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:58 devstack sudo[106669]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944" returned: 0 in 0.811s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:58 devstack sudo[106680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3 Jul 09 10:23:58 devstack sudo[106680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:59 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e676efa2-2b9c-4ee5-8dab-f0b68bc414ab tempest-CinderUnicodeTest-1578535637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.e61c6512-bc1f-4511-b8da-c4489df6a51b" returned: 0 in 0.698s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e676efa2-2b9c-4ee5-8dab-f0b68bc414ab tempest-CinderUnicodeTest-1578535637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:59 devstack sudo[106683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.info Jul 09 10:23:59 devstack sudo[106683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-543eba2e-9b37-4766-ac6e-2b86d25a2e3c tempest-ProjectAdminTests-819013450 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.7577781677246, 'free_capacity_gb': 1775.7577781677246, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87192) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 09 10:23:59 devstack sudo[106680]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3" returned: 0 in 0.719s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:59 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3 Jul 09 10:23:59 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:23:59 devstack sudo[106683]: pam_unix(sudo:session): session closed for user root Jul 09 10:23:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e676efa2-2b9c-4ee5-8dab-f0b68bc414ab tempest-CinderUnicodeTest-1578535637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.info" returned: 0 in 0.664s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:23:59 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-e676efa2-2b9c-4ee5-8dab-f0b68bc414ab tempest-CinderUnicodeTest-1578535637 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.info is being set with open permissions: ugo+rw Jul 09 10:23:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e676efa2-2b9c-4ee5-8dab-f0b68bc414ab tempest-CinderUnicodeTest-1578535637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:23:59 devstack sudo[106691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.info Jul 09 10:23:59 devstack sudo[106691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:00 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944.08fc633b-742e-46d9-9931-bf9935fd67f3" returned: 0 in 0.652s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] Lock "cinder-quobyte-08fc633b-742e-46d9-9931-bf9935fd67f3" released by "_delete_snapshot" :: held 3.133s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] Lock "cinder-quobyte-456b899c-83a7-4550-8d66-d800af413944" released by "delete_snapshot" :: held 3.163s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] Created reservations ['1c53bd6a-7693-40c1-83b6-20aa6117b66a', 'c7d6cbd6-f9c7-4f59-9051-eb15ad2700c0', '7a58496b-b500-44e3-a4b3-da8e32b43694', '0218c553-e74b-4f79-8f66-0f11c9eec263'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:24:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] Delete snapshot completed successfully. Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-275460f9-07b6-4cc5-acdc-d87782800e8f tempest-SnapshotDependencyTests-1477459490 None] Lock "cinder-08fc633b-742e-46d9-9931-bf9935fd67f3-delete_snapshot" released by "delete_snapshot" :: held 3.311s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:00 devstack sudo[106691]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e676efa2-2b9c-4ee5-8dab-f0b68bc414ab tempest-CinderUnicodeTest-1578535637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.info" returned: 0 in 0.703s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e676efa2-2b9c-4ee5-8dab-f0b68bc414ab tempest-CinderUnicodeTest-1578535637 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.596s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.192s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:23:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2051895824',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7835d27-8949-4187-8913-5fbdf57db5ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6cb952d36274d9ebd3768f8b096727d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:23:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:23:50Z,use_quota=True,user_id='9dbf0a948faa44f7bd93bc2a9664fa94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Creating volume a7835d27-8949-4187-8913-5fbdf57db5ec {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:24:00 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a7835d27-8949-4187-8913-5fbdf57db5ec 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:00 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a7835d27-8949-4187-8913-5fbdf57db5ec 1073741824 Jul 09 10:24:00 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e676efa2-2b9c-4ee5-8dab-f0b68bc414ab tempest-CinderUnicodeTest-1578535637 None] Create snapshot completed successfully Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] Acquiring lock "cinder-e61c6512-bc1f-4511-b8da-c4489df6a51b-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] Lock "cinder-e61c6512-bc1f-4511-b8da-c4489df6a51b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] Acquiring lock "cinder-quobyte-301b7d4a-5243-4979-82ce-4cb4350407ec" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] Lock "cinder-quobyte-301b7d4a-5243-4979-82ce-4cb4350407ec" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] Acquiring lock "cinder-quobyte-e61c6512-bc1f-4511-b8da-c4489df6a51b" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] Lock "cinder-quobyte-e61c6512-bc1f-4511-b8da-c4489df6a51b" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] Deleting offline snapshot e61c6512-bc1f-4511-b8da-c4489df6a51b of volume 301b7d4a-5243-4979-82ce-4cb4350407ec {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] snapshot_file for this snap is: volume-301b7d4a-5243-4979-82ce-4cb4350407ec.e61c6512-bc1f-4511-b8da-c4489df6a51b {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2787be2d-a5c7-4a0f-93ab-8876439fcfe8]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.e61c6512-bc1f-4511-b8da-c4489df6a51b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:00 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.e61c6512-bc1f-4511-b8da-c4489df6a51b Jul 09 10:24:00 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3076092a-26ea-447b-9056-0a6836186170 tempest-SnapshotDependencyTests-1477459490 None] Acquiring lock "cinder-456b899c-83a7-4550-8d66-d800af413944-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3076092a-26ea-447b-9056-0a6836186170 tempest-SnapshotDependencyTests-1477459490 None] Lock "cinder-456b899c-83a7-4550-8d66-d800af413944-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3076092a-26ea-447b-9056-0a6836186170 tempest-SnapshotDependencyTests-1477459490 None] Acquiring lock "cinder-quobyte-456b899c-83a7-4550-8d66-d800af413944" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3076092a-26ea-447b-9056-0a6836186170 tempest-SnapshotDependencyTests-1477459490 None] Lock "cinder-quobyte-456b899c-83a7-4550-8d66-d800af413944" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:01 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7caf6359-c5a0-459c-a162-6386eaa20065]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3076092a-26ea-447b-9056-0a6836186170 tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:01 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a7835d27-8949-4187-8913-5fbdf57db5ec 1073741824" returned: 0 in 1.033s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a7835d27-8949-4187-8913-5fbdf57db5ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:01 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 Jul 09 10:24:01 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:01 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a7835d27-8949-4187-8913-5fbdf57db5ec Jul 09 10:24:01 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:01 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.e61c6512-bc1f-4511-b8da-c4489df6a51b" returned: 0 in 0.986s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-301b7d4a-5243-4979-82ce-4cb4350407ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:24:01 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8db96338-50cf-40d5-914a-c2a5f71e29cb]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:02 devstack sudo[106711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec Jul 09 10:24:02 devstack sudo[106711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:02 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a7835d27-8949-4187-8913-5fbdf57db5ec" returned: 0 in 0.773s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] <== create_volume: return (1857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:24:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.860s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9147e044-e98b-467e-a24f-cb843264ae9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7835d27-8949-4187-8913-5fbdf57db5ec', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa7c0728-00ac-4d3d-9348-e58572ac300e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:02 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Volume volume-a7835d27-8949-4187-8913-5fbdf57db5ec (a7835d27-8949-4187-8913-5fbdf57db5ec): created successfully Jul 09 10:24:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa7c0728-00ac-4d3d-9348-e58572ac300e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:02 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Flow 'volume_create_manager' (33754c8f-6ecb-4ca8-ab71-83c67cb33e32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:24:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-705b5e10-cf3e-421e-a5ae-67a1c101ddef tempest-ProjectReaderTests-235090306 None] Created volume successfully. Jul 09 10:24:02 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3076092a-26ea-447b-9056-0a6836186170 tempest-SnapshotDependencyTests-1477459490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944" returned: 0 in 1.016s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3076092a-26ea-447b-9056-0a6836186170 tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:02 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944 Jul 09 10:24:02 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:02 devstack sudo[106711]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec" returned: 0 in 0.967s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.e61c6512-bc1f-4511-b8da-c4489df6a51b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:02 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.e61c6512-bc1f-4511-b8da-c4489df6a51b Jul 09 10:24:02 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:03 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3076092a-26ea-447b-9056-0a6836186170 tempest-SnapshotDependencyTests-1477459490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-456b899c-83a7-4550-8d66-d800af413944" returned: 0 in 0.741s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3076092a-26ea-447b-9056-0a6836186170 tempest-SnapshotDependencyTests-1477459490 None] Lock "cinder-quobyte-456b899c-83a7-4550-8d66-d800af413944" released by "delete_volume" :: held 1.827s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-3076092a-26ea-447b-9056-0a6836186170 tempest-SnapshotDependencyTests-1477459490 None] Created reservations ['63c22f26-c3be-4f09-b708-9ce3138f1795', 'eb902fa3-573b-46b8-844f-01977525ea56', '891f1af7-9261-46ec-b216-f9182942f305', 'ae126c86-a08b-400c-8e99-db8a9497a275'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3076092a-26ea-447b-9056-0a6836186170 tempest-SnapshotDependencyTests-1477459490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3076092a-26ea-447b-9056-0a6836186170 tempest-SnapshotDependencyTests-1477459490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3076092a-26ea-447b-9056-0a6836186170 tempest-SnapshotDependencyTests-1477459490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3076092a-26ea-447b-9056-0a6836186170 tempest-SnapshotDependencyTests-1477459490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3076092a-26ea-447b-9056-0a6836186170 tempest-SnapshotDependencyTests-1477459490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3076092a-26ea-447b-9056-0a6836186170 tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:03 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:24:03 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3e96f53-4e83-4119-ad04-20fc4fde5bee tempest-ProjectReaderTests-235090306 None] Acquiring lock "cinder-a7835d27-8949-4187-8913-5fbdf57db5ec-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3e96f53-4e83-4119-ad04-20fc4fde5bee tempest-ProjectReaderTests-235090306 None] Lock "cinder-a7835d27-8949-4187-8913-5fbdf57db5ec-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3e96f53-4e83-4119-ad04-20fc4fde5bee tempest-ProjectReaderTests-235090306 None] Acquiring lock "cinder-quobyte-a7835d27-8949-4187-8913-5fbdf57db5ec" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3e96f53-4e83-4119-ad04-20fc4fde5bee tempest-ProjectReaderTests-235090306 None] Lock "cinder-quobyte-a7835d27-8949-4187-8913-5fbdf57db5ec" acquired by "delete_volume" :: waited 0.025s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a497e957-99e4-4eb6-86e0-e7f5cec68358]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3e96f53-4e83-4119-ad04-20fc4fde5bee tempest-ProjectReaderTests-235090306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a7835d27-8949-4187-8913-5fbdf57db5ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:03 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.e61c6512-bc1f-4511-b8da-c4489df6a51b" returned: 0 in 0.929s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.e61c6512-bc1f-4511-b8da-c4489df6a51b {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d2899399-3341-4d32-a9c6-35f2479f5ef3 tempest-SnapshotDependencyTests-1477459490 None] Acquiring lock "cinder-40f0a55c-c911-49a1-8482-6f8392656912-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:03 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a7835d27-8949-4187-8913-5fbdf57db5ec Jul 09 10:24:03 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:03 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.e61c6512-bc1f-4511-b8da-c4489df6a51b Jul 09 10:24:03 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d2899399-3341-4d32-a9c6-35f2479f5ef3 tempest-SnapshotDependencyTests-1477459490 None] Lock "cinder-40f0a55c-c911-49a1-8482-6f8392656912-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d2899399-3341-4d32-a9c6-35f2479f5ef3 tempest-SnapshotDependencyTests-1477459490 None] Acquiring lock "cinder-quobyte-40f0a55c-c911-49a1-8482-6f8392656912" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:03 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d2899399-3341-4d32-a9c6-35f2479f5ef3 tempest-SnapshotDependencyTests-1477459490 None] Lock "cinder-quobyte-40f0a55c-c911-49a1-8482-6f8392656912" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3e27ac4-d07c-4a3e-b32d-2c03e0378d73]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2899399-3341-4d32-a9c6-35f2479f5ef3 tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40f0a55c-c911-49a1-8482-6f8392656912 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:04 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40f0a55c-c911-49a1-8482-6f8392656912 Jul 09 10:24:04 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Flow 'volume_create_manager' (c128e230-bb8f-472c-b828-b6e7782d0382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c9534d-64ba-490c-879f-d4b37a8f7bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69c9534d-64ba-490c-879f-d4b37a8f7bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2030464005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d02d93a7-06b1-4c5d-b040-f9b872b501ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12458de7c7c430393d29923401ca96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:24:04Z,use_quota=True,user_id='f8a913eedb0a421c8ab342bed701c8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37538bce-0356-405b-b544-c76d1c9f9751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37538bce-0356-405b-b544-c76d1c9f9751) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b47d89c-4119-4a02-8f90-42bbb5ebec6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4b47d89c-4119-4a02-8f90-42bbb5ebec6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd02d93a7-06b1-4c5d-b040-f9b872b501ad', 'volume_name': 'volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58012387-0b54-4634-858f-9c265da75ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58012387-0b54-4634-858f-9c265da75ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f04e7916-cad3-4982-8327-d048950b1df7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:04 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Volume d02d93a7-06b1-4c5d-b040-f9b872b501ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad', 'volume_size': 1} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:24:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2030464005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d02d93a7-06b1-4c5d-b040-f9b872b501ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12458de7c7c430393d29923401ca96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:24:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:24:04Z,use_quota=True,user_id='f8a913eedb0a421c8ab342bed701c8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Creating volume d02d93a7-06b1-4c5d-b040-f9b872b501ad {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:24:04 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:04 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad 1073741824 Jul 09 10:24:04 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:04 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3076092a-26ea-447b-9056-0a6836186170 tempest-SnapshotDependencyTests-1477459490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.071s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-3076092a-26ea-447b-9056-0a6836186170 tempest-SnapshotDependencyTests-1477459490 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:24:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3076092a-26ea-447b-9056-0a6836186170 tempest-SnapshotDependencyTests-1477459490 None] Deleted volume successfully. Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3076092a-26ea-447b-9056-0a6836186170 tempest-SnapshotDependencyTests-1477459490 None] Lock "cinder-456b899c-83a7-4550-8d66-d800af413944-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:04 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec.e61c6512-bc1f-4511-b8da-c4489df6a51b" returned: 0 in 0.973s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:04 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3e96f53-4e83-4119-ad04-20fc4fde5bee tempest-ProjectReaderTests-235090306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a7835d27-8949-4187-8913-5fbdf57db5ec" returned: 0 in 1.163s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3e96f53-4e83-4119-ad04-20fc4fde5bee tempest-ProjectReaderTests-235090306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a7835d27-8949-4187-8913-5fbdf57db5ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] Lock "cinder-quobyte-e61c6512-bc1f-4511-b8da-c4489df6a51b" released by "_delete_snapshot" :: held 4.004s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] Lock "cinder-quobyte-301b7d4a-5243-4979-82ce-4cb4350407ec" released by "delete_snapshot" :: held 4.033s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:04 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a7835d27-8949-4187-8913-5fbdf57db5ec Jul 09 10:24:04 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] Created reservations ['e65ef996-2cdb-4e82-a5a2-1e88a4c3ab1b', '47bfc1cf-ea3d-4df1-95ac-df8714bfc1ac', '2582c805-5efe-4d02-aded-5f85695dfeb1', '9c5526ef-9526-491a-b0e3-4ad217617d46'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:24:04 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2899399-3341-4d32-a9c6-35f2479f5ef3 tempest-SnapshotDependencyTests-1477459490 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40f0a55c-c911-49a1-8482-6f8392656912" returned: 0 in 0.962s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2899399-3341-4d32-a9c6-35f2479f5ef3 tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40f0a55c-c911-49a1-8482-6f8392656912 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] Delete snapshot completed successfully. Jul 09 10:24:05 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40f0a55c-c911-49a1-8482-6f8392656912 Jul 09 10:24:05 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a1924bf4-5bc5-41b0-8520-2fd904c2117b tempest-CinderUnicodeTest-1578535637 None] Lock "cinder-e61c6512-bc1f-4511-b8da-c4489df6a51b-delete_snapshot" released by "delete_snapshot" :: held 4.261s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c55f2f1c-9cc5-4f26-86e9-e9d8912021d0 tempest-CinderUnicodeTest-1578535637 None] Acquiring lock "cinder-301b7d4a-5243-4979-82ce-4cb4350407ec-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c55f2f1c-9cc5-4f26-86e9-e9d8912021d0 tempest-CinderUnicodeTest-1578535637 None] Lock "cinder-301b7d4a-5243-4979-82ce-4cb4350407ec-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c55f2f1c-9cc5-4f26-86e9-e9d8912021d0 tempest-CinderUnicodeTest-1578535637 None] Acquiring lock "cinder-quobyte-301b7d4a-5243-4979-82ce-4cb4350407ec" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c55f2f1c-9cc5-4f26-86e9-e9d8912021d0 tempest-CinderUnicodeTest-1578535637 None] Lock "cinder-quobyte-301b7d4a-5243-4979-82ce-4cb4350407ec" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0e14c83-80cb-488a-81ba-a51cec3e39cb]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c55f2f1c-9cc5-4f26-86e9-e9d8912021d0 tempest-CinderUnicodeTest-1578535637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:05 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec Jul 09 10:24:05 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:05 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad 1073741824" returned: 0 in 1.097s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:05 devstack sudo[106760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad Jul 09 10:24:05 devstack sudo[106760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:05 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3e96f53-4e83-4119-ad04-20fc4fde5bee tempest-ProjectReaderTests-235090306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a7835d27-8949-4187-8913-5fbdf57db5ec" returned: 0 in 0.808s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3e96f53-4e83-4119-ad04-20fc4fde5bee tempest-ProjectReaderTests-235090306 None] Lock "cinder-quobyte-a7835d27-8949-4187-8913-5fbdf57db5ec" released by "delete_volume" :: held 2.016s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a3e96f53-4e83-4119-ad04-20fc4fde5bee tempest-ProjectReaderTests-235090306 None] Created reservations ['14c2d20f-d677-415d-852a-19641dd97b63', '737056e8-0bc9-403b-8ec6-824b2d958436', '656ded8b-cd00-4ae1-9fca-4c2b0514d733', 'd0e3b90b-fb57-431a-899b-0676dbe7a09e'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:24:05 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2899399-3341-4d32-a9c6-35f2479f5ef3 tempest-SnapshotDependencyTests-1477459490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-40f0a55c-c911-49a1-8482-6f8392656912" returned: 0 in 0.774s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a3e96f53-4e83-4119-ad04-20fc4fde5bee tempest-ProjectReaderTests-235090306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a3e96f53-4e83-4119-ad04-20fc4fde5bee tempest-ProjectReaderTests-235090306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a3e96f53-4e83-4119-ad04-20fc4fde5bee tempest-ProjectReaderTests-235090306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a3e96f53-4e83-4119-ad04-20fc4fde5bee tempest-ProjectReaderTests-235090306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a3e96f53-4e83-4119-ad04-20fc4fde5bee tempest-ProjectReaderTests-235090306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3e96f53-4e83-4119-ad04-20fc4fde5bee tempest-ProjectReaderTests-235090306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d2899399-3341-4d32-a9c6-35f2479f5ef3 tempest-SnapshotDependencyTests-1477459490 None] Lock "cinder-quobyte-40f0a55c-c911-49a1-8482-6f8392656912" released by "delete_volume" :: held 1.818s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:05 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:24:05 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d2899399-3341-4d32-a9c6-35f2479f5ef3 tempest-SnapshotDependencyTests-1477459490 None] Created reservations ['04f0bea9-c15a-404b-b7b0-a63063780867', 'e2b8f0e1-91ab-4adc-9d01-dbe7988f84b2', '2ce833bd-638f-4b3a-940b-267a02fbbc0a', '171012ed-e8bc-4f25-a397-d736beb4f3ef'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d2899399-3341-4d32-a9c6-35f2479f5ef3 tempest-SnapshotDependencyTests-1477459490 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d2899399-3341-4d32-a9c6-35f2479f5ef3 tempest-SnapshotDependencyTests-1477459490 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d2899399-3341-4d32-a9c6-35f2479f5ef3 tempest-SnapshotDependencyTests-1477459490 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-d2899399-3341-4d32-a9c6-35f2479f5ef3 tempest-SnapshotDependencyTests-1477459490 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d2899399-3341-4d32-a9c6-35f2479f5ef3 tempest-SnapshotDependencyTests-1477459490 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2899399-3341-4d32-a9c6-35f2479f5ef3 tempest-SnapshotDependencyTests-1477459490 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:06 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:24:06 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:06 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c55f2f1c-9cc5-4f26-86e9-e9d8912021d0 tempest-CinderUnicodeTest-1578535637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec" returned: 0 in 1.051s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c55f2f1c-9cc5-4f26-86e9-e9d8912021d0 tempest-CinderUnicodeTest-1578535637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:06 devstack sudo[106773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec Jul 09 10:24:06 devstack sudo[106773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:06 devstack sudo[106760]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad" returned: 0 in 0.970s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] <== create_volume: return (2115ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f04e7916-cad3-4982-8327-d048950b1df7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d566a0c-9fc5-4968-a786-6505af1df7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:06 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Volume volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad (d02d93a7-06b1-4c5d-b040-f9b872b501ad): created successfully Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d566a0c-9fc5-4968-a786-6505af1df7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Flow 'volume_create_manager' (c128e230-bb8f-472c-b828-b6e7782d0382) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:24:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-80cb69e4-0561-495a-b191-854b96d48068 tempest-ProjectMemberTests-643462856 None] Created volume successfully. Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Flow 'volume_create_manager' (1ea9b069-90e1-4258-ad14-e4fe898216f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dcbcce9-ca1d-4cdd-a96b-bb129ce6c7c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2dcbcce9-ca1d-4cdd-a96b-bb129ce6c7c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1409641738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=860b7392-da1d-496e-8c3a-8f5a633753ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6cb952d36274d9ebd3768f8b096727d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:24:07Z,use_quota=True,user_id='9dbf0a948faa44f7bd93bc2a9664fa94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7f9b11-43d0-4a7b-8e1b-a4bf70dbabed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e7f9b11-43d0-4a7b-8e1b-a4bf70dbabed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ed488c-25e2-4573-893b-02e8f6d3d0cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3ed488c-25e2-4573-893b-02e8f6d3d0cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '860b7392-da1d-496e-8c3a-8f5a633753ae', 'volume_name': 'volume-860b7392-da1d-496e-8c3a-8f5a633753ae', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5856283b-1a0a-4cde-ac6f-c15e11e2edf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5856283b-1a0a-4cde-ac6f-c15e11e2edf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f260001-13cb-4c5b-b90f-74b99e2123f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:06 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Volume 860b7392-da1d-496e-8c3a-8f5a633753ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-860b7392-da1d-496e-8c3a-8f5a633753ae', 'volume_size': 1} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:24:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1409641738',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=860b7392-da1d-496e-8c3a-8f5a633753ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c6cb952d36274d9ebd3768f8b096727d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:24:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:24:07Z,use_quota=True,user_id='9dbf0a948faa44f7bd93bc2a9664fa94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Creating volume 860b7392-da1d-496e-8c3a-8f5a633753ae {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:24:06 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-860b7392-da1d-496e-8c3a-8f5a633753ae 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:06 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-860b7392-da1d-496e-8c3a-8f5a633753ae 1073741824 Jul 09 10:24:06 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:06 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d2899399-3341-4d32-a9c6-35f2479f5ef3 tempest-SnapshotDependencyTests-1477459490 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.922s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-d2899399-3341-4d32-a9c6-35f2479f5ef3 tempest-SnapshotDependencyTests-1477459490 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:24:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d2899399-3341-4d32-a9c6-35f2479f5ef3 tempest-SnapshotDependencyTests-1477459490 None] Deleted volume successfully. Jul 09 10:24:06 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a3e96f53-4e83-4119-ad04-20fc4fde5bee tempest-ProjectReaderTests-235090306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.132s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-a3e96f53-4e83-4119-ad04-20fc4fde5bee tempest-ProjectReaderTests-235090306 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:24:06 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a3e96f53-4e83-4119-ad04-20fc4fde5bee tempest-ProjectReaderTests-235090306 None] Deleted volume successfully. Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d2899399-3341-4d32-a9c6-35f2479f5ef3 tempest-SnapshotDependencyTests-1477459490 None] Lock "cinder-40f0a55c-c911-49a1-8482-6f8392656912-delete_volume" released by "delete_volume" :: held 3.078s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a3e96f53-4e83-4119-ad04-20fc4fde5bee tempest-ProjectReaderTests-235090306 None] Lock "cinder-a7835d27-8949-4187-8913-5fbdf57db5ec-delete_volume" released by "delete_volume" :: held 3.423s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:07 devstack sudo[106773]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c55f2f1c-9cc5-4f26-86e9-e9d8912021d0 tempest-CinderUnicodeTest-1578535637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-301b7d4a-5243-4979-82ce-4cb4350407ec" returned: 0 in 0.946s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c55f2f1c-9cc5-4f26-86e9-e9d8912021d0 tempest-CinderUnicodeTest-1578535637 None] Lock "cinder-quobyte-301b7d4a-5243-4979-82ce-4cb4350407ec" released by "delete_volume" :: held 2.075s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:07 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c55f2f1c-9cc5-4f26-86e9-e9d8912021d0 tempest-CinderUnicodeTest-1578535637 None] Created reservations ['f7aa5b9a-9dc2-41b9-9c41-512521cc4343', '35f71690-8865-4274-958d-2e262635ecae', 'fe9d5d02-591d-41ff-aa2d-e2539d775868', '0a266826-2644-4761-bb4b-04bb8aaa8718'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:24:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c55f2f1c-9cc5-4f26-86e9-e9d8912021d0 tempest-CinderUnicodeTest-1578535637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c55f2f1c-9cc5-4f26-86e9-e9d8912021d0 tempest-CinderUnicodeTest-1578535637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c55f2f1c-9cc5-4f26-86e9-e9d8912021d0 tempest-CinderUnicodeTest-1578535637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:24:07 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c55f2f1c-9cc5-4f26-86e9-e9d8912021d0 tempest-CinderUnicodeTest-1578535637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:24:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c55f2f1c-9cc5-4f26-86e9-e9d8912021d0 tempest-CinderUnicodeTest-1578535637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c55f2f1c-9cc5-4f26-86e9-e9d8912021d0 tempest-CinderUnicodeTest-1578535637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:07 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:24:07 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c2370395-1f09-4aef-9c95-28ff81491d69 tempest-CinderUnicodeTest-1578535637 None] Acquiring lock "cinder-75c7c752-b264-4564-90ef-bab74ffb1aaf-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c2370395-1f09-4aef-9c95-28ff81491d69 tempest-CinderUnicodeTest-1578535637 None] Lock "cinder-75c7c752-b264-4564-90ef-bab74ffb1aaf-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c2370395-1f09-4aef-9c95-28ff81491d69 tempest-CinderUnicodeTest-1578535637 None] Acquiring lock "cinder-quobyte-75c7c752-b264-4564-90ef-bab74ffb1aaf" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c2370395-1f09-4aef-9c95-28ff81491d69 tempest-CinderUnicodeTest-1578535637 None] Lock "cinder-quobyte-75c7c752-b264-4564-90ef-bab74ffb1aaf" acquired by "delete_volume" :: waited 0.023s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:07 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d398a8d-85af-4b70-9b66-eaca72f11d72]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2370395-1f09-4aef-9c95-28ff81491d69 tempest-CinderUnicodeTest-1578535637 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75c7c752-b264-4564-90ef-bab74ffb1aaf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-860b7392-da1d-496e-8c3a-8f5a633753ae 1073741824" returned: 0 in 1.082s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:07 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:07 devstack sudo[106786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75c7c752-b264-4564-90ef-bab74ffb1aaf Jul 09 10:24:07 devstack sudo[106786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-860b7392-da1d-496e-8c3a-8f5a633753ae {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f7a8a8d2-e5e9-43a5-9d60-be23bb08f55e tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:07 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-860b7392-da1d-496e-8c3a-8f5a633753ae Jul 09 10:24:07 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:08 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c55f2f1c-9cc5-4f26-86e9-e9d8912021d0 tempest-CinderUnicodeTest-1578535637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.872s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:08 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-c55f2f1c-9cc5-4f26-86e9-e9d8912021d0 tempest-CinderUnicodeTest-1578535637 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:24:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c55f2f1c-9cc5-4f26-86e9-e9d8912021d0 tempest-CinderUnicodeTest-1578535637 None] Deleted volume successfully. Jul 09 10:24:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c55f2f1c-9cc5-4f26-86e9-e9d8912021d0 tempest-CinderUnicodeTest-1578535637 None] Lock "cinder-301b7d4a-5243-4979-82ce-4cb4350407ec-delete_volume" released by "delete_volume" :: held 3.255s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:08 devstack sudo[106786]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2370395-1f09-4aef-9c95-28ff81491d69 tempest-CinderUnicodeTest-1578535637 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75c7c752-b264-4564-90ef-bab74ffb1aaf" returned: 0 in 0.972s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2370395-1f09-4aef-9c95-28ff81491d69 tempest-CinderUnicodeTest-1578535637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75c7c752-b264-4564-90ef-bab74ffb1aaf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:08 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-860b7392-da1d-496e-8c3a-8f5a633753ae" returned: 0 in 0.795s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] <== create_volume: return (1954ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:24:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.957s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:08 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75c7c752-b264-4564-90ef-bab74ffb1aaf Jul 09 10:24:08 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f7a8a8d2-e5e9-43a5-9d60-be23bb08f55e tempest-ProjectMemberTests-643462856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.786s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f260001-13cb-4c5b-b90f-74b99e2123f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-860b7392-da1d-496e-8c3a-8f5a633753ae', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ccf0c7-802b-40b0-a40a-2e27ed2b3863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-f7a8a8d2-e5e9-43a5-9d60-be23bb08f55e tempest-ProjectMemberTests-643462856 None] Creating offline snapshot acea49fe-3090-49cf-992d-845865dff238 of volume d02d93a7-06b1-4c5d-b040-f9b872b501ad {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:24:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Volume volume-860b7392-da1d-496e-8c3a-8f5a633753ae (860b7392-da1d-496e-8c3a-8f5a633753ae): created successfully Jul 09 10:24:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ccf0c7-802b-40b0-a40a-2e27ed2b3863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Flow 'volume_create_manager' (1ea9b069-90e1-4258-ad14-e4fe898216f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:24:08 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f034958-8882-4a9d-b62d-68356307aa0f]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f7a8a8d2-e5e9-43a5-9d60-be23bb08f55e tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:08 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b33a1136-000e-42f8-aadb-050b941b15cf tempest-ProjectReaderTests-235090306 None] Created volume successfully. Jul 09 10:24:08 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad Jul 09 10:24:08 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:09 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2370395-1f09-4aef-9c95-28ff81491d69 tempest-CinderUnicodeTest-1578535637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-75c7c752-b264-4564-90ef-bab74ffb1aaf" returned: 0 in 0.735s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c2370395-1f09-4aef-9c95-28ff81491d69 tempest-CinderUnicodeTest-1578535637 None] Lock "cinder-quobyte-75c7c752-b264-4564-90ef-bab74ffb1aaf" released by "delete_volume" :: held 1.764s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:09 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c2370395-1f09-4aef-9c95-28ff81491d69 tempest-CinderUnicodeTest-1578535637 None] Created reservations ['de7474f5-7ca5-4053-abe1-3bf9cadf898e', '62eeaabb-9257-43c4-b917-af8c83f4d20f', 'd83d15ab-4d3b-4b93-9ddf-70077f874253', '43279b22-0ab8-462a-8f84-a4c51c291603'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:24:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c2370395-1f09-4aef-9c95-28ff81491d69 tempest-CinderUnicodeTest-1578535637 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c2370395-1f09-4aef-9c95-28ff81491d69 tempest-CinderUnicodeTest-1578535637 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c2370395-1f09-4aef-9c95-28ff81491d69 tempest-CinderUnicodeTest-1578535637 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:24:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c2370395-1f09-4aef-9c95-28ff81491d69 tempest-CinderUnicodeTest-1578535637 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:24:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c2370395-1f09-4aef-9c95-28ff81491d69 tempest-CinderUnicodeTest-1578535637 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2370395-1f09-4aef-9c95-28ff81491d69 tempest-CinderUnicodeTest-1578535637 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:09 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:24:09 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:09 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f7a8a8d2-e5e9-43a5-9d60-be23bb08f55e tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad" returned: 0 in 0.838s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f7a8a8d2-e5e9-43a5-9d60-be23bb08f55e tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.acea49fe-3090-49cf-992d-845865dff238 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:09 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.acea49fe-3090-49cf-992d-845865dff238 1G Jul 09 10:24:09 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-da8030fc-1078-41ab-ae74-847b2edec684 tempest-ProjectReaderTests-235090306 None] Acquiring lock "cinder-860b7392-da1d-496e-8c3a-8f5a633753ae-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-da8030fc-1078-41ab-ae74-847b2edec684 tempest-ProjectReaderTests-235090306 None] Lock "cinder-860b7392-da1d-496e-8c3a-8f5a633753ae-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-da8030fc-1078-41ab-ae74-847b2edec684 tempest-ProjectReaderTests-235090306 None] Acquiring lock "cinder-quobyte-860b7392-da1d-496e-8c3a-8f5a633753ae" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-da8030fc-1078-41ab-ae74-847b2edec684 tempest-ProjectReaderTests-235090306 None] Lock "cinder-quobyte-860b7392-da1d-496e-8c3a-8f5a633753ae" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:10 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f44c552-eddd-41cc-b6c3-21d05d07f20f]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-da8030fc-1078-41ab-ae74-847b2edec684 tempest-ProjectReaderTests-235090306 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-860b7392-da1d-496e-8c3a-8f5a633753ae {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:10 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-860b7392-da1d-496e-8c3a-8f5a633753ae Jul 09 10:24:10 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:10 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c2370395-1f09-4aef-9c95-28ff81491d69 tempest-CinderUnicodeTest-1578535637 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 1.044s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:10 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-c2370395-1f09-4aef-9c95-28ff81491d69 tempest-CinderUnicodeTest-1578535637 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:24:10 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c2370395-1f09-4aef-9c95-28ff81491d69 tempest-CinderUnicodeTest-1578535637 None] Deleted volume successfully. Jul 09 10:24:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c2370395-1f09-4aef-9c95-28ff81491d69 tempest-CinderUnicodeTest-1578535637 None] Lock "cinder-75c7c752-b264-4564-90ef-bab74ffb1aaf-delete_volume" released by "delete_volume" :: held 3.080s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:10 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f7a8a8d2-e5e9-43a5-9d60-be23bb08f55e tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.acea49fe-3090-49cf-992d-845865dff238 1G" returned: 0 in 1.147s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f7a8a8d2-e5e9-43a5-9d60-be23bb08f55e tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.acea49fe-3090-49cf-992d-845865dff238 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:10 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.acea49fe-3090-49cf-992d-845865dff238 Jul 09 10:24:10 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:11 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-da8030fc-1078-41ab-ae74-847b2edec684 tempest-ProjectReaderTests-235090306 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-860b7392-da1d-496e-8c3a-8f5a633753ae" returned: 0 in 1.145s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-da8030fc-1078-41ab-ae74-847b2edec684 tempest-ProjectReaderTests-235090306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-860b7392-da1d-496e-8c3a-8f5a633753ae {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:11 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-860b7392-da1d-496e-8c3a-8f5a633753ae Jul 09 10:24:11 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:11 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f7a8a8d2-e5e9-43a5-9d60-be23bb08f55e tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.acea49fe-3090-49cf-992d-845865dff238" returned: 0 in 0.841s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:11 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-f7a8a8d2-e5e9-43a5-9d60-be23bb08f55e tempest-ProjectMemberTests-643462856 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.acea49fe-3090-49cf-992d-845865dff238 is being set with open permissions: ugo+rw Jul 09 10:24:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f7a8a8d2-e5e9-43a5-9d60-be23bb08f55e tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.acea49fe-3090-49cf-992d-845865dff238 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:11 devstack sudo[106829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.acea49fe-3090-49cf-992d-845865dff238 Jul 09 10:24:11 devstack sudo[106829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:12 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-da8030fc-1078-41ab-ae74-847b2edec684 tempest-ProjectReaderTests-235090306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-860b7392-da1d-496e-8c3a-8f5a633753ae" returned: 0 in 0.827s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:12 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-da8030fc-1078-41ab-ae74-847b2edec684 tempest-ProjectReaderTests-235090306 None] Lock "cinder-quobyte-860b7392-da1d-496e-8c3a-8f5a633753ae" released by "delete_volume" :: held 2.057s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:12 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-da8030fc-1078-41ab-ae74-847b2edec684 tempest-ProjectReaderTests-235090306 None] Created reservations ['e8095b5e-05dd-420b-8c63-78d8cad06d4c', '00290a3d-564a-47b0-82ea-5808094156ce', '96bab600-3b4f-402f-a359-a2f4c4a45c35', 'acb60b61-aeb4-4521-853c-2255a8f9bdd5'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:24:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-da8030fc-1078-41ab-ae74-847b2edec684 tempest-ProjectReaderTests-235090306 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-da8030fc-1078-41ab-ae74-847b2edec684 tempest-ProjectReaderTests-235090306 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-da8030fc-1078-41ab-ae74-847b2edec684 tempest-ProjectReaderTests-235090306 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:24:12 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-da8030fc-1078-41ab-ae74-847b2edec684 tempest-ProjectReaderTests-235090306 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:24:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-da8030fc-1078-41ab-ae74-847b2edec684 tempest-ProjectReaderTests-235090306 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-da8030fc-1078-41ab-ae74-847b2edec684 tempest-ProjectReaderTests-235090306 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:12 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:24:12 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:12 devstack sudo[106829]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f7a8a8d2-e5e9-43a5-9d60-be23bb08f55e tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.acea49fe-3090-49cf-992d-845865dff238" returned: 0 in 0.949s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f7a8a8d2-e5e9-43a5-9d60-be23bb08f55e tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:12 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.info Jul 09 10:24:12 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:13 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-da8030fc-1078-41ab-ae74-847b2edec684 tempest-ProjectReaderTests-235090306 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.860s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:13 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-da8030fc-1078-41ab-ae74-847b2edec684 tempest-ProjectReaderTests-235090306 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:24:13 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-da8030fc-1078-41ab-ae74-847b2edec684 tempest-ProjectReaderTests-235090306 None] Deleted volume successfully. Jul 09 10:24:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-da8030fc-1078-41ab-ae74-847b2edec684 tempest-ProjectReaderTests-235090306 None] Lock "cinder-860b7392-da1d-496e-8c3a-8f5a633753ae-delete_volume" released by "delete_volume" :: held 3.263s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:13 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f7a8a8d2-e5e9-43a5-9d60-be23bb08f55e tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.info" returned: 0 in 0.839s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:13 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-f7a8a8d2-e5e9-43a5-9d60-be23bb08f55e tempest-ProjectMemberTests-643462856 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.info is being set with open permissions: ugo+rw Jul 09 10:24:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f7a8a8d2-e5e9-43a5-9d60-be23bb08f55e tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:13 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.info Jul 09 10:24:13 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:14 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-f7a8a8d2-e5e9-43a5-9d60-be23bb08f55e tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.info" returned: 0 in 0.726s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-f7a8a8d2-e5e9-43a5-9d60-be23bb08f55e tempest-ProjectMemberTests-643462856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.514s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-f7a8a8d2-e5e9-43a5-9d60-be23bb08f55e tempest-ProjectMemberTests-643462856 None] Create snapshot completed successfully Jul 09 10:24:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-acea49fe-3090-49cf-992d-845865dff238-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] Lock "cinder-acea49fe-3090-49cf-992d-845865dff238-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-d02d93a7-06b1-4c5d-b040-f9b872b501ad" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-d02d93a7-06b1-4c5d-b040-f9b872b501ad" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-acea49fe-3090-49cf-992d-845865dff238" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-acea49fe-3090-49cf-992d-845865dff238" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] Deleting offline snapshot acea49fe-3090-49cf-992d-845865dff238 of volume d02d93a7-06b1-4c5d-b040-f9b872b501ad {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:24:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] snapshot_file for this snap is: volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.acea49fe-3090-49cf-992d-845865dff238 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:24:15 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aad9cba-a575-447d-bf5a-af0f2cacae22]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.acea49fe-3090-49cf-992d-845865dff238 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:15 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.acea49fe-3090-49cf-992d-845865dff238 Jul 09 10:24:15 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:16 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.acea49fe-3090-49cf-992d-845865dff238" returned: 0 in 0.827s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:24:16 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f79ce21-34c8-4de4-bc10-8bca219514bf]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:16 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad Jul 09 10:24:16 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:16 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad" returned: 0 in 0.760s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.acea49fe-3090-49cf-992d-845865dff238 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:17 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.acea49fe-3090-49cf-992d-845865dff238 Jul 09 10:24:17 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:17 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.acea49fe-3090-49cf-992d-845865dff238" returned: 0 in 0.771s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.acea49fe-3090-49cf-992d-845865dff238 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:17 devstack sudo[106863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.acea49fe-3090-49cf-992d-845865dff238 Jul 09 10:24:17 devstack sudo[106863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:18 devstack sudo[106863]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad.acea49fe-3090-49cf-992d-845865dff238" returned: 0 in 0.674s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-acea49fe-3090-49cf-992d-845865dff238" released by "_delete_snapshot" :: held 3.134s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-d02d93a7-06b1-4c5d-b040-f9b872b501ad" released by "delete_snapshot" :: held 3.156s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:18 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] Created reservations ['a66575e8-6052-49a7-b28c-0cafce210c26', '45adffe1-5a67-44c1-a690-c786838269eb', '7fa5469c-7ef7-4d63-872f-0903d8f1910d', 'da71a9c1-9d61-47d2-853f-5112b28a332b'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:24:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] Delete snapshot completed successfully. Jul 09 10:24:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-cfa2fde9-7e2e-426b-8b6e-8187385b80ac tempest-ProjectMemberTests-643462856 None] Lock "cinder-acea49fe-3090-49cf-992d-845865dff238-delete_snapshot" released by "delete_snapshot" :: held 3.284s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6b528c66-297d-44c8-ac42-07dff5738de6 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-d02d93a7-06b1-4c5d-b040-f9b872b501ad-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6b528c66-297d-44c8-ac42-07dff5738de6 tempest-ProjectMemberTests-643462856 None] Lock "cinder-d02d93a7-06b1-4c5d-b040-f9b872b501ad-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6b528c66-297d-44c8-ac42-07dff5738de6 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-d02d93a7-06b1-4c5d-b040-f9b872b501ad" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:19 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6b528c66-297d-44c8-ac42-07dff5738de6 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-d02d93a7-06b1-4c5d-b040-f9b872b501ad" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:19 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a07ba83b-9273-4eee-b69c-8178323adcb7]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b528c66-297d-44c8-ac42-07dff5738de6 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:19 devstack sudo[106867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad Jul 09 10:24:19 devstack sudo[106867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:20 devstack sudo[106867]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b528c66-297d-44c8-ac42-07dff5738de6 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad" returned: 0 in 0.756s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b528c66-297d-44c8-ac42-07dff5738de6 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:20 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad Jul 09 10:24:20 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:21 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b528c66-297d-44c8-ac42-07dff5738de6 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-d02d93a7-06b1-4c5d-b040-f9b872b501ad" returned: 0 in 0.637s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6b528c66-297d-44c8-ac42-07dff5738de6 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-d02d93a7-06b1-4c5d-b040-f9b872b501ad" released by "delete_volume" :: held 1.449s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:21 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-6b528c66-297d-44c8-ac42-07dff5738de6 tempest-ProjectMemberTests-643462856 None] Created reservations ['d0553ea1-1392-4e74-af15-35dd755c923e', '371529a6-a0f2-44bf-9ba2-889639c3a34f', 'cf226ab2-f00a-46a8-9c90-47c9ac7d47f3', '9f56d3c1-1d0b-4548-98e2-63ad53a1ce15'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:24:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6b528c66-297d-44c8-ac42-07dff5738de6 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6b528c66-297d-44c8-ac42-07dff5738de6 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6b528c66-297d-44c8-ac42-07dff5738de6 tempest-ProjectMemberTests-643462856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:24:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6b528c66-297d-44c8-ac42-07dff5738de6 tempest-ProjectMemberTests-643462856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:24:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6b528c66-297d-44c8-ac42-07dff5738de6 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b528c66-297d-44c8-ac42-07dff5738de6 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:21 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:24:21 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:21 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6b528c66-297d-44c8-ac42-07dff5738de6 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.648s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:21 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-6b528c66-297d-44c8-ac42-07dff5738de6 tempest-ProjectMemberTests-643462856 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:24:21 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6b528c66-297d-44c8-ac42-07dff5738de6 tempest-ProjectMemberTests-643462856 None] Deleted volume successfully. Jul 09 10:24:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6b528c66-297d-44c8-ac42-07dff5738de6 tempest-ProjectMemberTests-643462856 None] Lock "cinder-d02d93a7-06b1-4c5d-b040-f9b872b501ad-delete_volume" released by "delete_volume" :: held 2.278s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Flow 'volume_create_manager' (282ba89d-c3dc-4d9c-9d58-5e256b251f7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d289750e-fbd5-459a-80cc-9e0df16b2936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d289750e-fbd5-459a-80cc-9e0df16b2936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-824661052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f721950-d98f-4731-b210-88e3596eb2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12458de7c7c430393d29923401ca96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:24:22Z,use_quota=True,user_id='f8a913eedb0a421c8ab342bed701c8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2897506a-6e95-4978-8ff6-a13741b7340e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2897506a-6e95-4978-8ff6-a13741b7340e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bc9dcf-324f-474c-9eba-ae108f373fbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7bc9dcf-324f-474c-9eba-ae108f373fbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7f721950-d98f-4731-b210-88e3596eb2d4', 'volume_name': 'volume-7f721950-d98f-4731-b210-88e3596eb2d4', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b81ef9-a5b6-46fb-8c72-1db69a7c203c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3b81ef9-a5b6-46fb-8c72-1db69a7c203c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527a8ab7-9212-4648-86bf-af45474b9b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:22 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Volume 7f721950-d98f-4731-b210-88e3596eb2d4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7f721950-d98f-4731-b210-88e3596eb2d4', 'volume_size': 1} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:24:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-824661052',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7f721950-d98f-4731-b210-88e3596eb2d4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12458de7c7c430393d29923401ca96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:24:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:24:22Z,use_quota=True,user_id='f8a913eedb0a421c8ab342bed701c8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Creating volume 7f721950-d98f-4731-b210-88e3596eb2d4 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:24:22 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:24:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:22 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4 1073741824 Jul 09 10:24:22 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:23 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4 1073741824" returned: 0 in 0.808s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:23 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4 Jul 09 10:24:23 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:23 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4" returned: 0 in 0.654s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] <== create_volume: return (1510ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:24:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.513s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (527a8ab7-9212-4648-86bf-af45474b9b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7f721950-d98f-4731-b210-88e3596eb2d4', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3fe7379-7c04-42d4-ac10-f08b3c5bd2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:23 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Volume volume-7f721950-d98f-4731-b210-88e3596eb2d4 (7f721950-d98f-4731-b210-88e3596eb2d4): created successfully Jul 09 10:24:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b3fe7379-7c04-42d4-ac10-f08b3c5bd2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:23 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Flow 'volume_create_manager' (282ba89d-c3dc-4d9c-9d58-5e256b251f7f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:24:23 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-7cf3d9f3-da9b-4363-9499-4009da26c321 tempest-ProjectMemberTests-643462856 None] Created volume successfully. Jul 09 10:24:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc768487-c09d-426c-89cd-134577de3f06 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc768487-c09d-426c-89cd-134577de3f06 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-bc768487-c09d-426c-89cd-134577de3f06 tempest-ProjectMemberTests-643462856 None] Creating offline snapshot 8d233efc-06f7-4abb-a506-4385d9387a20 of volume 7f721950-d98f-4731-b210-88e3596eb2d4 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:24:24 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d232fc34-c7fd-4522-b29b-2aaf7141d73b]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc768487-c09d-426c-89cd-134577de3f06 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:24 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4 Jul 09 10:24:24 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:25 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc768487-c09d-426c-89cd-134577de3f06 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4" returned: 0 in 0.772s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc768487-c09d-426c-89cd-134577de3f06 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.8d233efc-06f7-4abb-a506-4385d9387a20 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:25 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.8d233efc-06f7-4abb-a506-4385d9387a20 1G Jul 09 10:24:25 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:25 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc768487-c09d-426c-89cd-134577de3f06 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.8d233efc-06f7-4abb-a506-4385d9387a20 1G" returned: 0 in 0.786s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc768487-c09d-426c-89cd-134577de3f06 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f721950-d98f-4731-b210-88e3596eb2d4 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.8d233efc-06f7-4abb-a506-4385d9387a20 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:25 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f721950-d98f-4731-b210-88e3596eb2d4 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.8d233efc-06f7-4abb-a506-4385d9387a20 Jul 09 10:24:25 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:26 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc768487-c09d-426c-89cd-134577de3f06 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7f721950-d98f-4731-b210-88e3596eb2d4 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.8d233efc-06f7-4abb-a506-4385d9387a20" returned: 0 in 0.679s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:26 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-bc768487-c09d-426c-89cd-134577de3f06 tempest-ProjectMemberTests-643462856 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.8d233efc-06f7-4abb-a506-4385d9387a20 is being set with open permissions: ugo+rw Jul 09 10:24:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc768487-c09d-426c-89cd-134577de3f06 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.8d233efc-06f7-4abb-a506-4385d9387a20 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:26 devstack sudo[106903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.8d233efc-06f7-4abb-a506-4385d9387a20 Jul 09 10:24:26 devstack sudo[106903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:27 devstack sudo[106903]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc768487-c09d-426c-89cd-134577de3f06 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.8d233efc-06f7-4abb-a506-4385d9387a20" returned: 0 in 0.652s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:27 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=140,cinder:INSERT=42,cinder:UPDATE=165,cinder:DELETE=11 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:24:27 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=111,cinder:INSERT=42,cinder:UPDATE=185,cinder:DELETE=20 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:24:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc768487-c09d-426c-89cd-134577de3f06 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:27 devstack sudo[106906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.info Jul 09 10:24:27 devstack sudo[106906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:27 devstack sudo[106906]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc768487-c09d-426c-89cd-134577de3f06 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.info" returned: 0 in 0.643s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:27 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-bc768487-c09d-426c-89cd-134577de3f06 tempest-ProjectMemberTests-643462856 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.info is being set with open permissions: ugo+rw Jul 09 10:24:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc768487-c09d-426c-89cd-134577de3f06 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:28 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.info Jul 09 10:24:28 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:28 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-bc768487-c09d-426c-89cd-134577de3f06 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.info" returned: 0 in 0.637s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-bc768487-c09d-426c-89cd-134577de3f06 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.253s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:28 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-bc768487-c09d-426c-89cd-134577de3f06 tempest-ProjectMemberTests-643462856 None] Create snapshot completed successfully Jul 09 10:24:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-8d233efc-06f7-4abb-a506-4385d9387a20-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] Lock "cinder-8d233efc-06f7-4abb-a506-4385d9387a20-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-7f721950-d98f-4731-b210-88e3596eb2d4" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-7f721950-d98f-4731-b210-88e3596eb2d4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-8d233efc-06f7-4abb-a506-4385d9387a20" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-8d233efc-06f7-4abb-a506-4385d9387a20" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] Deleting offline snapshot 8d233efc-06f7-4abb-a506-4385d9387a20 of volume 7f721950-d98f-4731-b210-88e3596eb2d4 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:24:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] snapshot_file for this snap is: volume-7f721950-d98f-4731-b210-88e3596eb2d4.8d233efc-06f7-4abb-a506-4385d9387a20 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:24:29 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6f3e28-67e1-48ae-9953-d7a13ce71794]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.8d233efc-06f7-4abb-a506-4385d9387a20 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:29 devstack sudo[106913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.8d233efc-06f7-4abb-a506-4385d9387a20 Jul 09 10:24:29 devstack sudo[106913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:24:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:24:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:24:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:29 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:24:29 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:30 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.637s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:24:30 devstack sudo[106913]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:24:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:24:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:24:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.8d233efc-06f7-4abb-a506-4385d9387a20" returned: 0 in 0.802s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7f721950-d98f-4731-b210-88e3596eb2d4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:24:30 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8644cb6f-40a2-4b4f-aea8-6244e606c238]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:30 devstack sudo[106921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4 Jul 09 10:24:30 devstack sudo[106921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:31 devstack sudo[106921]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4" returned: 0 in 0.739s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.8d233efc-06f7-4abb-a506-4385d9387a20 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:31 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.8d233efc-06f7-4abb-a506-4385d9387a20 Jul 09 10:24:31 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:31 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.8d233efc-06f7-4abb-a506-4385d9387a20" returned: 0 in 0.738s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.8d233efc-06f7-4abb-a506-4385d9387a20 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:31 devstack sudo[106931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.8d233efc-06f7-4abb-a506-4385d9387a20 Jul 09 10:24:31 devstack sudo[106931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:32 devstack sudo[106931]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4.8d233efc-06f7-4abb-a506-4385d9387a20" returned: 0 in 0.642s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-8d233efc-06f7-4abb-a506-4385d9387a20" released by "_delete_snapshot" :: held 3.021s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-7f721950-d98f-4731-b210-88e3596eb2d4" released by "delete_snapshot" :: held 3.041s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:32 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] Created reservations ['8bd8778b-4132-4c23-902a-3708afa236bb', 'ab0f9aaa-1ac8-4846-b9be-11f293846f3a', '9e190b57-f0e2-41d5-8f70-d7aa06c946bf', '5169c027-3bc0-4b7f-b958-f4b4716c2eb1'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:24:32 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] Delete snapshot completed successfully. Jul 09 10:24:32 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-21973af1-6a63-461c-9177-d0b95493d775 tempest-ProjectMemberTests-643462856 None] Lock "cinder-8d233efc-06f7-4abb-a506-4385d9387a20-delete_snapshot" released by "delete_snapshot" :: held 3.175s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3033db97-6797-4133-8f18-8264ef34e86d tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-7f721950-d98f-4731-b210-88e3596eb2d4-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3033db97-6797-4133-8f18-8264ef34e86d tempest-ProjectMemberTests-643462856 None] Lock "cinder-7f721950-d98f-4731-b210-88e3596eb2d4-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3033db97-6797-4133-8f18-8264ef34e86d tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-7f721950-d98f-4731-b210-88e3596eb2d4" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:33 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3033db97-6797-4133-8f18-8264ef34e86d tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-7f721950-d98f-4731-b210-88e3596eb2d4" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:33 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c853c99-5938-4399-a1cc-4ea222ca379e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3033db97-6797-4133-8f18-8264ef34e86d tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:34 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4 Jul 09 10:24:34 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:34 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3033db97-6797-4133-8f18-8264ef34e86d tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4" returned: 0 in 0.772s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3033db97-6797-4133-8f18-8264ef34e86d tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:34 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4 Jul 09 10:24:34 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:35 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3033db97-6797-4133-8f18-8264ef34e86d tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7f721950-d98f-4731-b210-88e3596eb2d4" returned: 0 in 0.664s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:35 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3033db97-6797-4133-8f18-8264ef34e86d tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-7f721950-d98f-4731-b210-88e3596eb2d4" released by "delete_volume" :: held 1.493s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:35 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-3033db97-6797-4133-8f18-8264ef34e86d tempest-ProjectMemberTests-643462856 None] Created reservations ['67422569-5beb-4991-affe-8d6cea35e2ba', 'ae4f5c25-7bcc-4732-86d9-2d63e293a7ea', '5d9703ae-1961-4183-970d-f3225aef5402', 'a5161a9c-c66e-4753-a6b9-de839a628718'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:24:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3033db97-6797-4133-8f18-8264ef34e86d tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3033db97-6797-4133-8f18-8264ef34e86d tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3033db97-6797-4133-8f18-8264ef34e86d tempest-ProjectMemberTests-643462856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:24:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3033db97-6797-4133-8f18-8264ef34e86d tempest-ProjectMemberTests-643462856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:24:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3033db97-6797-4133-8f18-8264ef34e86d tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3033db97-6797-4133-8f18-8264ef34e86d tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:35 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:24:35 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:36 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3033db97-6797-4133-8f18-8264ef34e86d tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.639s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-3033db97-6797-4133-8f18-8264ef34e86d tempest-ProjectMemberTests-643462856 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:24:36 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3033db97-6797-4133-8f18-8264ef34e86d tempest-ProjectMemberTests-643462856 None] Deleted volume successfully. Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3033db97-6797-4133-8f18-8264ef34e86d tempest-ProjectMemberTests-643462856 None] Lock "cinder-7f721950-d98f-4731-b210-88e3596eb2d4-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Flow 'volume_create_manager' (a2ca2368-afc7-4462-acf4-8eddc4a0baf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51f8d47-3df6-49e4-b293-75f82cf04133) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d51f8d47-3df6-49e4-b293-75f82cf04133) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1520842845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129f9c38-969a-42f2-91b2-e27922510d2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12458de7c7c430393d29923401ca96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:24:36Z,use_quota=True,user_id='f8a913eedb0a421c8ab342bed701c8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8b4017-6e58-4a3e-b4d9-2216cf1e005e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c8b4017-6e58-4a3e-b4d9-2216cf1e005e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb398b5e-2633-4918-98a7-4b591edebf40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb398b5e-2633-4918-98a7-4b591edebf40) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '129f9c38-969a-42f2-91b2-e27922510d2c', 'volume_name': 'volume-129f9c38-969a-42f2-91b2-e27922510d2c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ee5481-9e77-4fb3-bb35-23de8bb2bd6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ee5481-9e77-4fb3-bb35-23de8bb2bd6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be006214-5543-4a3c-9d0d-eb8f3684d95b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:36 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Volume 129f9c38-969a-42f2-91b2-e27922510d2c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-129f9c38-969a-42f2-91b2-e27922510d2c', 'volume_size': 1} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:24:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1520842845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=129f9c38-969a-42f2-91b2-e27922510d2c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12458de7c7c430393d29923401ca96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:24:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:24:36Z,use_quota=True,user_id='f8a913eedb0a421c8ab342bed701c8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Creating volume 129f9c38-969a-42f2-91b2-e27922510d2c {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:24:36 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:24:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:36 devstack sudo[106979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c 1073741824 Jul 09 10:24:36 devstack sudo[106979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:37 devstack sudo[106979]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c 1073741824" returned: 0 in 0.796s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:37 devstack sudo[106987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c Jul 09 10:24:37 devstack sudo[106987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:38 devstack sudo[106987]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c" returned: 0 in 0.671s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:24:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be006214-5543-4a3c-9d0d-eb8f3684d95b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-129f9c38-969a-42f2-91b2-e27922510d2c', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4518ee54-7060-4f6b-aa10-647e82c10edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:38 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Volume volume-129f9c38-969a-42f2-91b2-e27922510d2c (129f9c38-969a-42f2-91b2-e27922510d2c): created successfully Jul 09 10:24:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4518ee54-7060-4f6b-aa10-647e82c10edd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:38 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Flow 'volume_create_manager' (a2ca2368-afc7-4462-acf4-8eddc4a0baf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:24:38 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e21251fe-9b8f-4d50-aae9-ed06cb8dab1e tempest-ProjectMemberTests-643462856 None] Created volume successfully. Jul 09 10:24:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a96eaef3-8360-4f4e-b8f8-7d35f065b133 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a96eaef3-8360-4f4e-b8f8-7d35f065b133 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a96eaef3-8360-4f4e-b8f8-7d35f065b133 tempest-ProjectMemberTests-643462856 None] Creating offline snapshot 0393178d-b94d-47f0-926e-6d14988b6ab8 of volume 129f9c38-969a-42f2-91b2-e27922510d2c {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:24:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[db999afa-87ba-4615-997d-6f3fc9cfabe1]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a96eaef3-8360-4f4e-b8f8-7d35f065b133 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:38 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c Jul 09 10:24:38 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:39 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a96eaef3-8360-4f4e-b8f8-7d35f065b133 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c" returned: 0 in 0.758s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a96eaef3-8360-4f4e-b8f8-7d35f065b133 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.0393178d-b94d-47f0-926e-6d14988b6ab8 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:39 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.0393178d-b94d-47f0-926e-6d14988b6ab8 1G Jul 09 10:24:39 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:40 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a96eaef3-8360-4f4e-b8f8-7d35f065b133 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.0393178d-b94d-47f0-926e-6d14988b6ab8 1G" returned: 0 in 0.802s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a96eaef3-8360-4f4e-b8f8-7d35f065b133 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129f9c38-969a-42f2-91b2-e27922510d2c -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.0393178d-b94d-47f0-926e-6d14988b6ab8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:40 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129f9c38-969a-42f2-91b2-e27922510d2c -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.0393178d-b94d-47f0-926e-6d14988b6ab8 Jul 09 10:24:40 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:40 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a96eaef3-8360-4f4e-b8f8-7d35f065b133 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-129f9c38-969a-42f2-91b2-e27922510d2c -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.0393178d-b94d-47f0-926e-6d14988b6ab8" returned: 0 in 0.664s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:40 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-a96eaef3-8360-4f4e-b8f8-7d35f065b133 tempest-ProjectMemberTests-643462856 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.0393178d-b94d-47f0-926e-6d14988b6ab8 is being set with open permissions: ugo+rw Jul 09 10:24:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a96eaef3-8360-4f4e-b8f8-7d35f065b133 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.0393178d-b94d-47f0-926e-6d14988b6ab8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:40 devstack sudo[107006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.0393178d-b94d-47f0-926e-6d14988b6ab8 Jul 09 10:24:40 devstack sudo[107006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:41 devstack sudo[107006]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a96eaef3-8360-4f4e-b8f8-7d35f065b133 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.0393178d-b94d-47f0-926e-6d14988b6ab8" returned: 0 in 0.640s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a96eaef3-8360-4f4e-b8f8-7d35f065b133 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:41 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.info Jul 09 10:24:41 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:42 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a96eaef3-8360-4f4e-b8f8-7d35f065b133 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.info" returned: 0 in 0.622s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:42 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-a96eaef3-8360-4f4e-b8f8-7d35f065b133 tempest-ProjectMemberTests-643462856 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.info is being set with open permissions: ugo+rw Jul 09 10:24:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a96eaef3-8360-4f4e-b8f8-7d35f065b133 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:42 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.info Jul 09 10:24:42 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:42 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a96eaef3-8360-4f4e-b8f8-7d35f065b133 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.info" returned: 0 in 0.620s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a96eaef3-8360-4f4e-b8f8-7d35f065b133 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.180s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:42 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a96eaef3-8360-4f4e-b8f8-7d35f065b133 tempest-ProjectMemberTests-643462856 None] Create snapshot completed successfully Jul 09 10:24:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-0393178d-b94d-47f0-926e-6d14988b6ab8-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] Lock "cinder-0393178d-b94d-47f0-926e-6d14988b6ab8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-129f9c38-969a-42f2-91b2-e27922510d2c" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-129f9c38-969a-42f2-91b2-e27922510d2c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-0393178d-b94d-47f0-926e-6d14988b6ab8" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-0393178d-b94d-47f0-926e-6d14988b6ab8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] Deleting offline snapshot 0393178d-b94d-47f0-926e-6d14988b6ab8 of volume 129f9c38-969a-42f2-91b2-e27922510d2c {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:24:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] snapshot_file for this snap is: volume-129f9c38-969a-42f2-91b2-e27922510d2c.0393178d-b94d-47f0-926e-6d14988b6ab8 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:24:43 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e23d49e-dc1d-4eb2-b535-9564aae2744d]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.0393178d-b94d-47f0-926e-6d14988b6ab8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:44 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.0393178d-b94d-47f0-926e-6d14988b6ab8 Jul 09 10:24:44 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:44 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.0393178d-b94d-47f0-926e-6d14988b6ab8" returned: 0 in 0.732s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-129f9c38-969a-42f2-91b2-e27922510d2c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:24:44 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f24d2b4-d9a1-4f38-a3c3-9fe86a41d801]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:44 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c Jul 09 10:24:44 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:45 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c" returned: 0 in 0.752s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.0393178d-b94d-47f0-926e-6d14988b6ab8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:45 devstack sudo[107032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.0393178d-b94d-47f0-926e-6d14988b6ab8 Jul 09 10:24:45 devstack sudo[107032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:46 devstack sudo[107032]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.0393178d-b94d-47f0-926e-6d14988b6ab8" returned: 0 in 0.754s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.0393178d-b94d-47f0-926e-6d14988b6ab8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:46 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.0393178d-b94d-47f0-926e-6d14988b6ab8 Jul 09 10:24:46 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:46 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c.0393178d-b94d-47f0-926e-6d14988b6ab8" returned: 0 in 0.646s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-0393178d-b94d-47f0-926e-6d14988b6ab8" released by "_delete_snapshot" :: held 2.970s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-129f9c38-969a-42f2-91b2-e27922510d2c" released by "delete_snapshot" :: held 2.992s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:46 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] Created reservations ['d550f414-4952-4882-aeb7-65854ce2cd8c', 'bccd288d-a04e-4a9f-bc6b-471fa3371a42', 'e900ea2d-74ca-4e0a-b6f2-da22813c379d', '7147cb82-3b8b-41cc-bb0a-b168cd0bf915'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:24:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] Delete snapshot completed successfully. Jul 09 10:24:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-edca4f95-f854-4637-9b38-5e2d01fb19f3 tempest-ProjectMemberTests-643462856 None] Lock "cinder-0393178d-b94d-47f0-926e-6d14988b6ab8-delete_snapshot" released by "delete_snapshot" :: held 3.129s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0174bb68-754d-4295-a860-3ab4d71bc8ac tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-129f9c38-969a-42f2-91b2-e27922510d2c-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0174bb68-754d-4295-a860-3ab4d71bc8ac tempest-ProjectMemberTests-643462856 None] Lock "cinder-129f9c38-969a-42f2-91b2-e27922510d2c-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0174bb68-754d-4295-a860-3ab4d71bc8ac tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-129f9c38-969a-42f2-91b2-e27922510d2c" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0174bb68-754d-4295-a860-3ab4d71bc8ac tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-129f9c38-969a-42f2-91b2-e27922510d2c" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:47 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6509de-c799-4760-bcc8-b26cfd03f415]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0174bb68-754d-4295-a860-3ab4d71bc8ac tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:47 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c Jul 09 10:24:47 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:47 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0174bb68-754d-4295-a860-3ab4d71bc8ac tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c" returned: 0 in 0.756s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0174bb68-754d-4295-a860-3ab4d71bc8ac tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:48 devstack sudo[107045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c Jul 09 10:24:48 devstack sudo[107045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:48 devstack sudo[107045]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0174bb68-754d-4295-a860-3ab4d71bc8ac tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-129f9c38-969a-42f2-91b2-e27922510d2c" returned: 0 in 0.623s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0174bb68-754d-4295-a860-3ab4d71bc8ac tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-129f9c38-969a-42f2-91b2-e27922510d2c" released by "delete_volume" :: held 1.435s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:48 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-0174bb68-754d-4295-a860-3ab4d71bc8ac tempest-ProjectMemberTests-643462856 None] Created reservations ['7c960b3f-da2e-40c5-8ae4-3531d2d62f1f', 'a37dd4f9-f234-46db-8ee3-c1916aeb7c79', '47ce536f-e92b-49d2-92f2-20aa71cdea25', '15d79286-d841-419f-83ed-c9c87564308f'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:24:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0174bb68-754d-4295-a860-3ab4d71bc8ac tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0174bb68-754d-4295-a860-3ab4d71bc8ac tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0174bb68-754d-4295-a860-3ab4d71bc8ac tempest-ProjectMemberTests-643462856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:24:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0174bb68-754d-4295-a860-3ab4d71bc8ac tempest-ProjectMemberTests-643462856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:24:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0174bb68-754d-4295-a860-3ab4d71bc8ac tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0174bb68-754d-4295-a860-3ab4d71bc8ac tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:48 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:24:48 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:49 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0174bb68-754d-4295-a860-3ab4d71bc8ac tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.629s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-0174bb68-754d-4295-a860-3ab4d71bc8ac tempest-ProjectMemberTests-643462856 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:24:49 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0174bb68-754d-4295-a860-3ab4d71bc8ac tempest-ProjectMemberTests-643462856 None] Deleted volume successfully. Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-0174bb68-754d-4295-a860-3ab4d71bc8ac tempest-ProjectMemberTests-643462856 None] Lock "cinder-129f9c38-969a-42f2-91b2-e27922510d2c-delete_volume" released by "delete_volume" :: held 2.260s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Flow 'volume_create_manager' (8c617a70-be75-47cf-ad76-3926120c3d9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18c1280-48b3-43fa-9168-f7a1ab560211) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c18c1280-48b3-43fa-9168-f7a1ab560211) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1049936550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a017b10a-8607-4fc6-b98b-868193e76715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12458de7c7c430393d29923401ca96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:24:50Z,use_quota=True,user_id='f8a913eedb0a421c8ab342bed701c8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7a3e81-2efb-4ad8-9619-94b41281111e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af7a3e81-2efb-4ad8-9619-94b41281111e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8876556e-b5cf-4090-abc4-a614bc1e00b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8876556e-b5cf-4090-abc4-a614bc1e00b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a017b10a-8607-4fc6-b98b-868193e76715', 'volume_name': 'volume-a017b10a-8607-4fc6-b98b-868193e76715', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5642fb77-413f-47c4-bb32-651c3780d3bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5642fb77-413f-47c4-bb32-651c3780d3bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42e4a3e-794c-4afe-b95f-b32d3f0922c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:49 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Volume a017b10a-8607-4fc6-b98b-868193e76715: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a017b10a-8607-4fc6-b98b-868193e76715', 'volume_size': 1} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:24:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1049936550',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a017b10a-8607-4fc6-b98b-868193e76715,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12458de7c7c430393d29923401ca96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:24:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:24:50Z,use_quota=True,user_id='f8a913eedb0a421c8ab342bed701c8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Creating volume a017b10a-8607-4fc6-b98b-868193e76715 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:24:49 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:24:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:49 devstack sudo[107052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715 1073741824 Jul 09 10:24:49 devstack sudo[107052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:50 devstack sudo[107052]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715 1073741824" returned: 0 in 0.831s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:50 devstack sudo[107057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715 Jul 09 10:24:50 devstack sudo[107057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:51 devstack sudo[107057]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715" returned: 0 in 0.627s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] <== create_volume: return (1513ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:24:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.515s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a42e4a3e-794c-4afe-b95f-b32d3f0922c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a017b10a-8607-4fc6-b98b-868193e76715', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c470c73-375a-4bc3-963e-6c7e66705780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:24:51 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Volume volume-a017b10a-8607-4fc6-b98b-868193e76715 (a017b10a-8607-4fc6-b98b-868193e76715): created successfully Jul 09 10:24:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c470c73-375a-4bc3-963e-6c7e66705780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:24:51 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Flow 'volume_create_manager' (8c617a70-be75-47cf-ad76-3926120c3d9a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:24:51 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c74f9f7b-a200-4bfa-92c9-52489c544fe6 tempest-ProjectMemberTests-643462856 None] Created volume successfully. Jul 09 10:24:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-70fd1d70-f901-4aae-9e12-7d7d78466827 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:24:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-70fd1d70-f901-4aae-9e12-7d7d78466827 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:24:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-70fd1d70-f901-4aae-9e12-7d7d78466827 tempest-ProjectMemberTests-643462856 None] Creating offline snapshot 1dc4197c-b667-46b1-97de-29bcd70da567 of volume a017b10a-8607-4fc6-b98b-868193e76715 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:24:52 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae20e5a4-1ac3-4141-b584-3798b460883d]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-70fd1d70-f901-4aae-9e12-7d7d78466827 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:52 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715 Jul 09 10:24:52 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:52 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-70fd1d70-f901-4aae-9e12-7d7d78466827 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715" returned: 0 in 0.790s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-70fd1d70-f901-4aae-9e12-7d7d78466827 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.1dc4197c-b667-46b1-97de-29bcd70da567 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:52 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.1dc4197c-b667-46b1-97de-29bcd70da567 1G Jul 09 10:24:52 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:53 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-70fd1d70-f901-4aae-9e12-7d7d78466827 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.1dc4197c-b667-46b1-97de-29bcd70da567 1G" returned: 0 in 0.833s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-70fd1d70-f901-4aae-9e12-7d7d78466827 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a017b10a-8607-4fc6-b98b-868193e76715 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.1dc4197c-b667-46b1-97de-29bcd70da567 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:53 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a017b10a-8607-4fc6-b98b-868193e76715 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.1dc4197c-b667-46b1-97de-29bcd70da567 Jul 09 10:24:53 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:54 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-70fd1d70-f901-4aae-9e12-7d7d78466827 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a017b10a-8607-4fc6-b98b-868193e76715 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.1dc4197c-b667-46b1-97de-29bcd70da567" returned: 0 in 0.665s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:54 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-70fd1d70-f901-4aae-9e12-7d7d78466827 tempest-ProjectMemberTests-643462856 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.1dc4197c-b667-46b1-97de-29bcd70da567 is being set with open permissions: ugo+rw Jul 09 10:24:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-70fd1d70-f901-4aae-9e12-7d7d78466827 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.1dc4197c-b667-46b1-97de-29bcd70da567 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:54 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.1dc4197c-b667-46b1-97de-29bcd70da567 Jul 09 10:24:54 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:54 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-70fd1d70-f901-4aae-9e12-7d7d78466827 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.1dc4197c-b667-46b1-97de-29bcd70da567" returned: 0 in 0.606s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-70fd1d70-f901-4aae-9e12-7d7d78466827 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:55 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.info Jul 09 10:24:55 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:55 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-70fd1d70-f901-4aae-9e12-7d7d78466827 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.info" returned: 0 in 0.627s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:55 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-70fd1d70-f901-4aae-9e12-7d7d78466827 tempest-ProjectMemberTests-643462856 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.info is being set with open permissions: ugo+rw Jul 09 10:24:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-70fd1d70-f901-4aae-9e12-7d7d78466827 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:55 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.info Jul 09 10:24:55 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:56 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-70fd1d70-f901-4aae-9e12-7d7d78466827 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.info" returned: 0 in 0.619s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-70fd1d70-f901-4aae-9e12-7d7d78466827 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.216s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:24:56 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-70fd1d70-f901-4aae-9e12-7d7d78466827 tempest-ProjectMemberTests-643462856 None] Create snapshot completed successfully Jul 09 10:24:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-1dc4197c-b667-46b1-97de-29bcd70da567-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] Lock "cinder-1dc4197c-b667-46b1-97de-29bcd70da567-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-a017b10a-8607-4fc6-b98b-868193e76715" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-a017b10a-8607-4fc6-b98b-868193e76715" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-1dc4197c-b667-46b1-97de-29bcd70da567" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:24:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-1dc4197c-b667-46b1-97de-29bcd70da567" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:24:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] Deleting offline snapshot 1dc4197c-b667-46b1-97de-29bcd70da567 of volume a017b10a-8607-4fc6-b98b-868193e76715 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:24:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] snapshot_file for this snap is: volume-a017b10a-8607-4fc6-b98b-868193e76715.1dc4197c-b667-46b1-97de-29bcd70da567 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:24:57 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[c63dd0c3-de19-46e2-bcdc-ef94f45a7a06]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.1dc4197c-b667-46b1-97de-29bcd70da567 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:57 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.1dc4197c-b667-46b1-97de-29bcd70da567 Jul 09 10:24:57 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:58 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.1dc4197c-b667-46b1-97de-29bcd70da567" returned: 0 in 0.798s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a017b10a-8607-4fc6-b98b-868193e76715(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:24:58 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef0f942b-1ed8-4cf2-b705-ad2aff0ffd36]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:24:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:58 devstack sudo[107090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715 Jul 09 10:24:58 devstack sudo[107090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:58 devstack sudo[107090]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715" returned: 0 in 0.728s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.1dc4197c-b667-46b1-97de-29bcd70da567 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:58 devstack sudo[107097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.1dc4197c-b667-46b1-97de-29bcd70da567 Jul 09 10:24:58 devstack sudo[107097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:24:59 devstack sudo[107097]: pam_unix(sudo:session): session closed for user root Jul 09 10:24:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.1dc4197c-b667-46b1-97de-29bcd70da567" returned: 0 in 0.730s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:24:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.1dc4197c-b667-46b1-97de-29bcd70da567 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:24:59 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.1dc4197c-b667-46b1-97de-29bcd70da567 Jul 09 10:24:59 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:00 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715.1dc4197c-b667-46b1-97de-29bcd70da567" returned: 0 in 0.618s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-1dc4197c-b667-46b1-97de-29bcd70da567" released by "_delete_snapshot" :: held 2.965s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-a017b10a-8607-4fc6-b98b-868193e76715" released by "delete_snapshot" :: held 2.985s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:00 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] Created reservations ['80c6db7f-e40d-4504-9f5c-5127ae76dec6', '39d06014-6bbd-47de-8843-3752bf1c12d3', '7d740651-5b3a-4ac7-b313-63012b26baaa', '4856f104-6fae-4db5-b570-8806e817b3a8'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:25:00 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] Delete snapshot completed successfully. Jul 09 10:25:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-285183cd-0abe-4d91-b895-51e5e9f4bdca tempest-ProjectMemberTests-643462856 None] Lock "cinder-1dc4197c-b667-46b1-97de-29bcd70da567-delete_snapshot" released by "delete_snapshot" :: held 3.124s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b04b72b3-7ddf-42c4-8f33-3942ee3fa4ea tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-a017b10a-8607-4fc6-b98b-868193e76715-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b04b72b3-7ddf-42c4-8f33-3942ee3fa4ea tempest-ProjectMemberTests-643462856 None] Lock "cinder-a017b10a-8607-4fc6-b98b-868193e76715-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b04b72b3-7ddf-42c4-8f33-3942ee3fa4ea tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-a017b10a-8607-4fc6-b98b-868193e76715" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b04b72b3-7ddf-42c4-8f33-3942ee3fa4ea tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-a017b10a-8607-4fc6-b98b-868193e76715" acquired by "delete_volume" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:00 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[afa54dd9-0859-4dda-ad3e-eb87a355b0f4]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:25:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b04b72b3-7ddf-42c4-8f33-3942ee3fa4ea tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:00 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715 Jul 09 10:25:00 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:01 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b04b72b3-7ddf-42c4-8f33-3942ee3fa4ea tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715" returned: 0 in 0.726s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b04b72b3-7ddf-42c4-8f33-3942ee3fa4ea tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:01 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715 Jul 09 10:25:01 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:01 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b04b72b3-7ddf-42c4-8f33-3942ee3fa4ea tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-a017b10a-8607-4fc6-b98b-868193e76715" returned: 0 in 0.619s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b04b72b3-7ddf-42c4-8f33-3942ee3fa4ea tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-a017b10a-8607-4fc6-b98b-868193e76715" released by "delete_volume" :: held 1.410s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:01 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-b04b72b3-7ddf-42c4-8f33-3942ee3fa4ea tempest-ProjectMemberTests-643462856 None] Created reservations ['8f98d65e-5f38-4643-9e3f-2d9c5035065a', '45cbbe5b-d161-430e-93b4-b09cef6e6d05', '8b3921a6-06fe-45a2-a4f1-c86b6aa13aa9', '6f90e90d-6d49-43f0-ad3a-9ce6765be6f8'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:25:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b04b72b3-7ddf-42c4-8f33-3942ee3fa4ea tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b04b72b3-7ddf-42c4-8f33-3942ee3fa4ea tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b04b72b3-7ddf-42c4-8f33-3942ee3fa4ea tempest-ProjectMemberTests-643462856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:25:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b04b72b3-7ddf-42c4-8f33-3942ee3fa4ea tempest-ProjectMemberTests-643462856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:25:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b04b72b3-7ddf-42c4-8f33-3942ee3fa4ea tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:25:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b04b72b3-7ddf-42c4-8f33-3942ee3fa4ea tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:02 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:25:02 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:02 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b04b72b3-7ddf-42c4-8f33-3942ee3fa4ea tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.688s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:02 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-b04b72b3-7ddf-42c4-8f33-3942ee3fa4ea tempest-ProjectMemberTests-643462856 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:25:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b04b72b3-7ddf-42c4-8f33-3942ee3fa4ea tempest-ProjectMemberTests-643462856 None] Deleted volume successfully. Jul 09 10:25:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b04b72b3-7ddf-42c4-8f33-3942ee3fa4ea tempest-ProjectMemberTests-643462856 None] Lock "cinder-a017b10a-8607-4fc6-b98b-868193e76715-delete_volume" released by "delete_volume" :: held 2.281s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Flow 'volume_create_manager' (b38c5136-a06d-4a95-806b-943b3b87cc12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f972ca9e-d0b1-4112-ad8c-42ef82b36c99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f972ca9e-d0b1-4112-ad8c-42ef82b36c99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-78304242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44793167-d4ea-4547-a977-07f139c94d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12458de7c7c430393d29923401ca96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:25:03Z,use_quota=True,user_id='f8a913eedb0a421c8ab342bed701c8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b57b9b0-a550-40b9-9b2c-b83a621774a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b57b9b0-a550-40b9-9b2c-b83a621774a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd15906e-2829-4d3f-92fc-5ab6a86fa088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd15906e-2829-4d3f-92fc-5ab6a86fa088) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44793167-d4ea-4547-a977-07f139c94d91', 'volume_name': 'volume-44793167-d4ea-4547-a977-07f139c94d91', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864fa9d2-1fd8-48a9-bdc4-0bfab622cd55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864fa9d2-1fd8-48a9-bdc4-0bfab622cd55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69de7628-2fc2-40a0-b0e5-08c21eb8e65c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:03 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Volume 44793167-d4ea-4547-a977-07f139c94d91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44793167-d4ea-4547-a977-07f139c94d91', 'volume_size': 1} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-78304242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44793167-d4ea-4547-a977-07f139c94d91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12458de7c7c430393d29923401ca96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:25:03Z,use_quota=True,user_id='f8a913eedb0a421c8ab342bed701c8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Creating volume 44793167-d4ea-4547-a977-07f139c94d91 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:25:03 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:03 devstack sudo[107450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91 1073741824 Jul 09 10:25:03 devstack sudo[107450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:03 devstack sudo[107450]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91 1073741824" returned: 0 in 0.772s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:04 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91 Jul 09 10:25:04 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:04 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91" returned: 0 in 0.610s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] <== create_volume: return (1423ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:25:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.425s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:25:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69de7628-2fc2-40a0-b0e5-08c21eb8e65c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44793167-d4ea-4547-a977-07f139c94d91', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069bdfde-a84f-4131-a515-ca4b2b1d7595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:04 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Volume volume-44793167-d4ea-4547-a977-07f139c94d91 (44793167-d4ea-4547-a977-07f139c94d91): created successfully Jul 09 10:25:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (069bdfde-a84f-4131-a515-ca4b2b1d7595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:04 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Flow 'volume_create_manager' (b38c5136-a06d-4a95-806b-943b3b87cc12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:25:04 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8721c379-b082-4cbd-b436-deb362eefd75 tempest-ProjectMemberTests-643462856 None] Created volume successfully. Jul 09 10:25:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cbd015bc-8003-4df5-8790-8488fd4a8d1a tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cbd015bc-8003-4df5-8790-8488fd4a8d1a tempest-ProjectMemberTests-643462856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-cbd015bc-8003-4df5-8790-8488fd4a8d1a tempest-ProjectMemberTests-643462856 None] Creating offline snapshot f18ddfaa-8d96-4131-bc95-26d4de706177 of volume 44793167-d4ea-4547-a977-07f139c94d91 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:25:05 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5034143-c4ac-4f23-8ccf-0805063c7a42]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:25:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cbd015bc-8003-4df5-8790-8488fd4a8d1a tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:05 devstack sudo[107460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91 Jul 09 10:25:05 devstack sudo[107460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:06 devstack sudo[107460]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cbd015bc-8003-4df5-8790-8488fd4a8d1a tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91" returned: 0 in 0.742s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cbd015bc-8003-4df5-8790-8488fd4a8d1a tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.f18ddfaa-8d96-4131-bc95-26d4de706177 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:06 devstack sudo[107466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.f18ddfaa-8d96-4131-bc95-26d4de706177 1G Jul 09 10:25:06 devstack sudo[107466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:06 devstack sudo[107466]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cbd015bc-8003-4df5-8790-8488fd4a8d1a tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.f18ddfaa-8d96-4131-bc95-26d4de706177 1G" returned: 0 in 0.763s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cbd015bc-8003-4df5-8790-8488fd4a8d1a tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44793167-d4ea-4547-a977-07f139c94d91 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.f18ddfaa-8d96-4131-bc95-26d4de706177 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:06 devstack sudo[107472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44793167-d4ea-4547-a977-07f139c94d91 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.f18ddfaa-8d96-4131-bc95-26d4de706177 Jul 09 10:25:06 devstack sudo[107472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:07 devstack sudo[107472]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cbd015bc-8003-4df5-8790-8488fd4a8d1a tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-44793167-d4ea-4547-a977-07f139c94d91 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.f18ddfaa-8d96-4131-bc95-26d4de706177" returned: 0 in 0.677s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:07 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-cbd015bc-8003-4df5-8790-8488fd4a8d1a tempest-ProjectMemberTests-643462856 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.f18ddfaa-8d96-4131-bc95-26d4de706177 is being set with open permissions: ugo+rw Jul 09 10:25:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cbd015bc-8003-4df5-8790-8488fd4a8d1a tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.f18ddfaa-8d96-4131-bc95-26d4de706177 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:07 devstack sudo[107478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.f18ddfaa-8d96-4131-bc95-26d4de706177 Jul 09 10:25:07 devstack sudo[107478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:08 devstack sudo[107478]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cbd015bc-8003-4df5-8790-8488fd4a8d1a tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.f18ddfaa-8d96-4131-bc95-26d4de706177" returned: 0 in 0.625s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cbd015bc-8003-4df5-8790-8488fd4a8d1a tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:08 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.info Jul 09 10:25:08 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:08 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cbd015bc-8003-4df5-8790-8488fd4a8d1a tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.info" returned: 0 in 0.623s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:08 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-cbd015bc-8003-4df5-8790-8488fd4a8d1a tempest-ProjectMemberTests-643462856 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.info is being set with open permissions: ugo+rw Jul 09 10:25:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cbd015bc-8003-4df5-8790-8488fd4a8d1a tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:08 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.info Jul 09 10:25:08 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:09 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-cbd015bc-8003-4df5-8790-8488fd4a8d1a tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.info" returned: 0 in 0.687s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-cbd015bc-8003-4df5-8790-8488fd4a8d1a tempest-ProjectMemberTests-643462856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.200s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:25:09 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-cbd015bc-8003-4df5-8790-8488fd4a8d1a tempest-ProjectMemberTests-643462856 None] Create snapshot completed successfully Jul 09 10:25:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-f18ddfaa-8d96-4131-bc95-26d4de706177-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] Lock "cinder-f18ddfaa-8d96-4131-bc95-26d4de706177-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-44793167-d4ea-4547-a977-07f139c94d91" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-44793167-d4ea-4547-a977-07f139c94d91" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-f18ddfaa-8d96-4131-bc95-26d4de706177" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-f18ddfaa-8d96-4131-bc95-26d4de706177" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] Deleting offline snapshot f18ddfaa-8d96-4131-bc95-26d4de706177 of volume 44793167-d4ea-4547-a977-07f139c94d91 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:25:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] snapshot_file for this snap is: volume-44793167-d4ea-4547-a977-07f139c94d91.f18ddfaa-8d96-4131-bc95-26d4de706177 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:25:10 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb18e1f-80c6-40a5-999a-738c87a84a94]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:25:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.f18ddfaa-8d96-4131-bc95-26d4de706177 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:10 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.f18ddfaa-8d96-4131-bc95-26d4de706177 Jul 09 10:25:10 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:11 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.f18ddfaa-8d96-4131-bc95-26d4de706177" returned: 0 in 0.764s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:11 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-44793167-d4ea-4547-a977-07f139c94d91(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:25:11 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[820bd225-496f-401a-a3ad-0265f2d86da4]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:25:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:11 devstack sudo[107493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91 Jul 09 10:25:11 devstack sudo[107493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:12 devstack sudo[107493]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91" returned: 0 in 0.732s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.f18ddfaa-8d96-4131-bc95-26d4de706177 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:12 devstack sudo[107498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.f18ddfaa-8d96-4131-bc95-26d4de706177 Jul 09 10:25:12 devstack sudo[107498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:12 devstack sudo[107498]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.f18ddfaa-8d96-4131-bc95-26d4de706177" returned: 0 in 0.692s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.f18ddfaa-8d96-4131-bc95-26d4de706177 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:12 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.f18ddfaa-8d96-4131-bc95-26d4de706177 Jul 09 10:25:12 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:13 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91.f18ddfaa-8d96-4131-bc95-26d4de706177" returned: 0 in 0.610s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-f18ddfaa-8d96-4131-bc95-26d4de706177" released by "_delete_snapshot" :: held 2.888s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-44793167-d4ea-4547-a977-07f139c94d91" released by "delete_snapshot" :: held 2.909s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:13 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] Created reservations ['1e5f9cc0-6f20-4cde-bf3c-9549ad543d7a', 'f3f78416-544a-48cb-ac9e-9cb252a8eabf', 'ae900ce9-0ab9-4a42-bddb-1073e3024f75', '4ce715b1-e158-4132-aa1a-b2fde018f50b'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:25:13 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] Delete snapshot completed successfully. Jul 09 10:25:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-a9b78fd8-05f9-428a-98af-c51f7a03ccb8 tempest-ProjectMemberTests-643462856 None] Lock "cinder-f18ddfaa-8d96-4131-bc95-26d4de706177-delete_snapshot" released by "delete_snapshot" :: held 3.040s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1f992a49-930d-4379-a074-364a167cd6d5 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-44793167-d4ea-4547-a977-07f139c94d91-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1f992a49-930d-4379-a074-364a167cd6d5 tempest-ProjectMemberTests-643462856 None] Lock "cinder-44793167-d4ea-4547-a977-07f139c94d91-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1f992a49-930d-4379-a074-364a167cd6d5 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-44793167-d4ea-4547-a977-07f139c94d91" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:13 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1f992a49-930d-4379-a074-364a167cd6d5 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-44793167-d4ea-4547-a977-07f139c94d91" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:13 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f2ee852-a5f3-4a2b-9bb1-c6913e1e652f]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:25:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1f992a49-930d-4379-a074-364a167cd6d5 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:13 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91 Jul 09 10:25:13 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:14 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1f992a49-930d-4379-a074-364a167cd6d5 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91" returned: 0 in 0.778s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1f992a49-930d-4379-a074-364a167cd6d5 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:14 devstack sudo[107511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91 Jul 09 10:25:14 devstack sudo[107511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:15 devstack sudo[107511]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1f992a49-930d-4379-a074-364a167cd6d5 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-44793167-d4ea-4547-a977-07f139c94d91" returned: 0 in 0.727s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1f992a49-930d-4379-a074-364a167cd6d5 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-44793167-d4ea-4547-a977-07f139c94d91" released by "delete_volume" :: held 1.560s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:15 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-1f992a49-930d-4379-a074-364a167cd6d5 tempest-ProjectMemberTests-643462856 None] Created reservations ['68e3b170-a43b-4f87-ad68-dd10885fb58e', '21be1453-8e3c-43b8-99e1-83537753f0a9', '5e64286d-037a-4a6b-95b3-3df6d9fd15c3', 'b82378bc-be83-42f7-b770-e6868a44e15b'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:25:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1f992a49-930d-4379-a074-364a167cd6d5 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1f992a49-930d-4379-a074-364a167cd6d5 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1f992a49-930d-4379-a074-364a167cd6d5 tempest-ProjectMemberTests-643462856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:25:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1f992a49-930d-4379-a074-364a167cd6d5 tempest-ProjectMemberTests-643462856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:25:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1f992a49-930d-4379-a074-364a167cd6d5 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:25:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1f992a49-930d-4379-a074-364a167cd6d5 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:15 devstack sudo[107514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:25:15 devstack sudo[107514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:16 devstack sudo[107514]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1f992a49-930d-4379-a074-364a167cd6d5 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.673s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-1f992a49-930d-4379-a074-364a167cd6d5 tempest-ProjectMemberTests-643462856 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:25:16 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1f992a49-930d-4379-a074-364a167cd6d5 tempest-ProjectMemberTests-643462856 None] Deleted volume successfully. Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1f992a49-930d-4379-a074-364a167cd6d5 tempest-ProjectMemberTests-643462856 None] Lock "cinder-44793167-d4ea-4547-a977-07f139c94d91-delete_volume" released by "delete_volume" :: held 2.444s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Flow 'volume_create_manager' (3087b133-6a1a-45c5-af32-25b9ab0906b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c9ec7bb-39b0-4e83-a8b5-09dcd09b4378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8c9ec7bb-39b0-4e83-a8b5-09dcd09b4378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-228444177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2e51cf-9ba5-4cba-908b-aa4923ce7932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12458de7c7c430393d29923401ca96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:25:16Z,use_quota=True,user_id='f8a913eedb0a421c8ab342bed701c8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb1c940-c381-4d6c-aa12-b5ff05f84205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (adb1c940-c381-4d6c-aa12-b5ff05f84205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8934db99-e9ba-4f54-8bbc-963a22d0bf4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8934db99-e9ba-4f54-8bbc-963a22d0bf4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef2e51cf-9ba5-4cba-908b-aa4923ce7932', 'volume_name': 'volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e137d8d-8d6c-4572-bbd9-9192425d40b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e137d8d-8d6c-4572-bbd9-9192425d40b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0cf144c-f20f-4344-91ef-34e778f88780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:16 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Volume ef2e51cf-9ba5-4cba-908b-aa4923ce7932: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932', 'volume_size': 1} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:25:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-228444177',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef2e51cf-9ba5-4cba-908b-aa4923ce7932,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12458de7c7c430393d29923401ca96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:25:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:25:16Z,use_quota=True,user_id='f8a913eedb0a421c8ab342bed701c8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Creating volume ef2e51cf-9ba5-4cba-908b-aa4923ce7932 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:25:16 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:25:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:16 devstack sudo[107517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932 1073741824 Jul 09 10:25:16 devstack sudo[107517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:17 devstack sudo[107517]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932 1073741824" returned: 0 in 0.819s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:17 devstack sudo[107522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932 Jul 09 10:25:17 devstack sudo[107522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:18 devstack sudo[107522]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932" returned: 0 in 0.663s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] <== create_volume: return (1522ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:25:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.525s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:25:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0cf144c-f20f-4344-91ef-34e778f88780) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af81ace7-6f79-4a04-af9d-5cded2059980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:18 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Volume volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932 (ef2e51cf-9ba5-4cba-908b-aa4923ce7932): created successfully Jul 09 10:25:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af81ace7-6f79-4a04-af9d-5cded2059980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:18 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Flow 'volume_create_manager' (3087b133-6a1a-45c5-af32-25b9ab0906b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:25:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-0f5eaaf7-a8a3-4122-b08c-81d09c94ccea tempest-ProjectMemberTests-643462856 None] Created volume successfully. Jul 09 10:25:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-90d2ded4-3461-4187-9afd-724a1a88cb83 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-90d2ded4-3461-4187-9afd-724a1a88cb83 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:18 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-90d2ded4-3461-4187-9afd-724a1a88cb83 tempest-ProjectMemberTests-643462856 None] Creating offline snapshot 21c8eef1-1ba2-4463-a00d-ebd1b0f88f55 of volume ef2e51cf-9ba5-4cba-908b-aa4923ce7932 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:25:18 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2179206-9fd5-4b67-9209-b9e22e9585d7]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:25:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-90d2ded4-3461-4187-9afd-724a1a88cb83 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:18 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932 Jul 09 10:25:18 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:19 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-90d2ded4-3461-4187-9afd-724a1a88cb83 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932" returned: 0 in 0.779s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-90d2ded4-3461-4187-9afd-724a1a88cb83 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.21c8eef1-1ba2-4463-a00d-ebd1b0f88f55 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:19 devstack sudo[107618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.21c8eef1-1ba2-4463-a00d-ebd1b0f88f55 1G Jul 09 10:25:19 devstack sudo[107618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:20 devstack sudo[107618]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-90d2ded4-3461-4187-9afd-724a1a88cb83 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.21c8eef1-1ba2-4463-a00d-ebd1b0f88f55 1G" returned: 0 in 0.796s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-90d2ded4-3461-4187-9afd-724a1a88cb83 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.21c8eef1-1ba2-4463-a00d-ebd1b0f88f55 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:20 devstack sudo[107623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.21c8eef1-1ba2-4463-a00d-ebd1b0f88f55 Jul 09 10:25:20 devstack sudo[107623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:20 devstack sudo[107623]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-90d2ded4-3461-4187-9afd-724a1a88cb83 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.21c8eef1-1ba2-4463-a00d-ebd1b0f88f55" returned: 0 in 0.697s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:20 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-90d2ded4-3461-4187-9afd-724a1a88cb83 tempest-ProjectMemberTests-643462856 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.21c8eef1-1ba2-4463-a00d-ebd1b0f88f55 is being set with open permissions: ugo+rw Jul 09 10:25:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-90d2ded4-3461-4187-9afd-724a1a88cb83 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.21c8eef1-1ba2-4463-a00d-ebd1b0f88f55 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:20 devstack sudo[107628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.21c8eef1-1ba2-4463-a00d-ebd1b0f88f55 Jul 09 10:25:20 devstack sudo[107628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:21 devstack sudo[107628]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-90d2ded4-3461-4187-9afd-724a1a88cb83 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.21c8eef1-1ba2-4463-a00d-ebd1b0f88f55" returned: 0 in 0.697s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-90d2ded4-3461-4187-9afd-724a1a88cb83 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:21 devstack sudo[107631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.info Jul 09 10:25:21 devstack sudo[107631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:22 devstack sudo[107631]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-90d2ded4-3461-4187-9afd-724a1a88cb83 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.info" returned: 0 in 0.655s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:22 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-90d2ded4-3461-4187-9afd-724a1a88cb83 tempest-ProjectMemberTests-643462856 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.info is being set with open permissions: ugo+rw Jul 09 10:25:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-90d2ded4-3461-4187-9afd-724a1a88cb83 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:22 devstack sudo[107634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.info Jul 09 10:25:22 devstack sudo[107634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:22 devstack sudo[107634]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-90d2ded4-3461-4187-9afd-724a1a88cb83 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.info" returned: 0 in 0.677s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-90d2ded4-3461-4187-9afd-724a1a88cb83 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.384s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:25:23 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-90d2ded4-3461-4187-9afd-724a1a88cb83 tempest-ProjectMemberTests-643462856 None] Create snapshot completed successfully Jul 09 10:25:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-21c8eef1-1ba2-4463-a00d-ebd1b0f88f55-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] Lock "cinder-21c8eef1-1ba2-4463-a00d-ebd1b0f88f55-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-ef2e51cf-9ba5-4cba-908b-aa4923ce7932" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-ef2e51cf-9ba5-4cba-908b-aa4923ce7932" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-21c8eef1-1ba2-4463-a00d-ebd1b0f88f55" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:23 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-21c8eef1-1ba2-4463-a00d-ebd1b0f88f55" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] Deleting offline snapshot 21c8eef1-1ba2-4463-a00d-ebd1b0f88f55 of volume ef2e51cf-9ba5-4cba-908b-aa4923ce7932 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:25:23 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] snapshot_file for this snap is: volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.21c8eef1-1ba2-4463-a00d-ebd1b0f88f55 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:25:23 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0808e368-3e71-43c9-8b1e-4ab233c03d64]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:25:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.21c8eef1-1ba2-4463-a00d-ebd1b0f88f55 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:24 devstack sudo[107637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.21c8eef1-1ba2-4463-a00d-ebd1b0f88f55 Jul 09 10:25:24 devstack sudo[107637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:24 devstack sudo[107637]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.21c8eef1-1ba2-4463-a00d-ebd1b0f88f55" returned: 0 in 0.772s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:24 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:25:24 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[aff1ef56-b072-4a52-b5aa-94e14be7bed1]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:25:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:24 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932 Jul 09 10:25:24 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:25 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932" returned: 0 in 0.798s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.21c8eef1-1ba2-4463-a00d-ebd1b0f88f55 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:25 devstack sudo[107647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.21c8eef1-1ba2-4463-a00d-ebd1b0f88f55 Jul 09 10:25:25 devstack sudo[107647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:26 devstack sudo[107647]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.21c8eef1-1ba2-4463-a00d-ebd1b0f88f55" returned: 0 in 0.779s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.21c8eef1-1ba2-4463-a00d-ebd1b0f88f55 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:26 devstack sudo[107653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.21c8eef1-1ba2-4463-a00d-ebd1b0f88f55 Jul 09 10:25:26 devstack sudo[107653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:26 devstack sudo[107653]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932.21c8eef1-1ba2-4463-a00d-ebd1b0f88f55" returned: 0 in 0.657s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-21c8eef1-1ba2-4463-a00d-ebd1b0f88f55" released by "_delete_snapshot" :: held 3.096s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-ef2e51cf-9ba5-4cba-908b-aa4923ce7932" released by "delete_snapshot" :: held 3.119s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:27 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] Created reservations ['d00faf5b-95df-4e4b-aa10-7c9adf2b05d7', '8565f5bd-e929-48ff-a3c8-fc1f1e1bbd7e', '69c8e987-ad37-4cfc-9d99-f8a36fc1fa1a', '88dadf40-a1ed-4b18-b9d6-d0a86b462249'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:25:27 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] Delete snapshot completed successfully. Jul 09 10:25:27 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9d39e809-7dba-4cfc-aa4b-099f5d63493c tempest-ProjectMemberTests-643462856 None] Lock "cinder-21c8eef1-1ba2-4463-a00d-ebd1b0f88f55-delete_snapshot" released by "delete_snapshot" :: held 3.252s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ce96bd11-39d3-46c9-a466-57c1109af752 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-ef2e51cf-9ba5-4cba-908b-aa4923ce7932-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ce96bd11-39d3-46c9-a466-57c1109af752 tempest-ProjectMemberTests-643462856 None] Lock "cinder-ef2e51cf-9ba5-4cba-908b-aa4923ce7932-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:28 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=66,cinder:UPDATE=74,cinder:INSERT=23,cinder:DELETE=5 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:25:28 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=60,cinder:INSERT=22,cinder:DELETE=8,cinder:UPDATE=83 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:25:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ce96bd11-39d3-46c9-a466-57c1109af752 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-ef2e51cf-9ba5-4cba-908b-aa4923ce7932" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:28 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ce96bd11-39d3-46c9-a466-57c1109af752 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-ef2e51cf-9ba5-4cba-908b-aa4923ce7932" acquired by "delete_volume" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:28 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ae9870a-466d-4401-94ef-d5f962ac1a81]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:25:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ce96bd11-39d3-46c9-a466-57c1109af752 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:28 devstack sudo[107656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932 Jul 09 10:25:28 devstack sudo[107656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:28 devstack sudo[107656]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ce96bd11-39d3-46c9-a466-57c1109af752 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932" returned: 0 in 0.775s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ce96bd11-39d3-46c9-a466-57c1109af752 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:28 devstack sudo[107662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932 Jul 09 10:25:28 devstack sudo[107662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:29 devstack sudo[107662]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ce96bd11-39d3-46c9-a466-57c1109af752 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ef2e51cf-9ba5-4cba-908b-aa4923ce7932" returned: 0 in 0.730s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:29 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ce96bd11-39d3-46c9-a466-57c1109af752 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-ef2e51cf-9ba5-4cba-908b-aa4923ce7932" released by "delete_volume" :: held 1.561s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:29 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ce96bd11-39d3-46c9-a466-57c1109af752 tempest-ProjectMemberTests-643462856 None] Created reservations ['7d0075e0-957e-4a22-a7b4-1714b9b9bad9', '4736930a-a73a-4ebd-8b0c-ef517a5a973b', '20d26b89-2806-473b-8fa6-12cb571f5e48', 'a3c2f528-fc03-49c4-a86a-ec6812dd2702'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:25:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:25:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:25:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:25:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:25:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:29 devstack sudo[107665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:25:29 devstack sudo[107665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ce96bd11-39d3-46c9-a466-57c1109af752 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ce96bd11-39d3-46c9-a466-57c1109af752 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ce96bd11-39d3-46c9-a466-57c1109af752 tempest-ProjectMemberTests-643462856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:25:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ce96bd11-39d3-46c9-a466-57c1109af752 tempest-ProjectMemberTests-643462856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:25:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ce96bd11-39d3-46c9-a466-57c1109af752 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:25:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ce96bd11-39d3-46c9-a466-57c1109af752 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:29 devstack sudo[107667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:25:29 devstack sudo[107667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:30 devstack sudo[107665]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.701s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:25:30 devstack sudo[107667]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ce96bd11-39d3-46c9-a466-57c1109af752 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.713s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-ce96bd11-39d3-46c9-a466-57c1109af752 tempest-ProjectMemberTests-643462856 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:25:30 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ce96bd11-39d3-46c9-a466-57c1109af752 tempest-ProjectMemberTests-643462856 None] Deleted volume successfully. Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ce96bd11-39d3-46c9-a466-57c1109af752 tempest-ProjectMemberTests-643462856 None] Lock "cinder-ef2e51cf-9ba5-4cba-908b-aa4923ce7932-delete_volume" released by "delete_volume" :: held 2.518s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Flow 'volume_create_manager' (9f801568-cd04-4703-a2d7-3644c2036570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a283ef0-9cfa-4e85-b4b5-e9122fad2113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a283ef0-9cfa-4e85-b4b5-e9122fad2113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1851016028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571c5b6f-e71b-4ba8-95da-ec0c80b01db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12458de7c7c430393d29923401ca96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:25:31Z,use_quota=True,user_id='f8a913eedb0a421c8ab342bed701c8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16b8138-5e62-4183-90c1-0c61fbc01298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16b8138-5e62-4183-90c1-0c61fbc01298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98f3bb6-357d-4834-9644-a58a8e119d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98f3bb6-357d-4834-9644-a58a8e119d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '571c5b6f-e71b-4ba8-95da-ec0c80b01db5', 'volume_name': 'volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8901b0f4-c204-4739-8851-4b794363ab8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8901b0f4-c204-4739-8851-4b794363ab8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd2ab73-6a0f-4b30-bb4a-5bea755ade24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:30 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Volume 571c5b6f-e71b-4ba8-95da-ec0c80b01db5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5', 'volume_size': 1} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:25:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1851016028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=571c5b6f-e71b-4ba8-95da-ec0c80b01db5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12458de7c7c430393d29923401ca96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:25:31Z,use_quota=True,user_id='f8a913eedb0a421c8ab342bed701c8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Creating volume 571c5b6f-e71b-4ba8-95da-ec0c80b01db5 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:25:30 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:25:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:30 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5 1073741824 Jul 09 10:25:30 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:31 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5 1073741824" returned: 0 in 0.857s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:31 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5 Jul 09 10:25:31 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:32 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5" returned: 0 in 0.633s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:32 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] <== create_volume: return (1531ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:25:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.534s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:25:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3fd2ab73-6a0f-4b30-bb4a-5bea755ade24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52b7485-8340-490e-b012-01d6bf870e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:32 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Volume volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5 (571c5b6f-e71b-4ba8-95da-ec0c80b01db5): created successfully Jul 09 10:25:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f52b7485-8340-490e-b012-01d6bf870e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:32 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Flow 'volume_create_manager' (9f801568-cd04-4703-a2d7-3644c2036570) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:25:32 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c206fc37-f28e-4b52-9598-a92ea6102972 tempest-ProjectMemberTests-643462856 None] Created volume successfully. Jul 09 10:25:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6ee91be0-5b1c-44f0-bca6-a2382af1eca8 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6ee91be0-5b1c-44f0-bca6-a2382af1eca8 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:33 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-6ee91be0-5b1c-44f0-bca6-a2382af1eca8 tempest-ProjectMemberTests-643462856 None] Creating offline snapshot ce1a72be-fdf1-42a7-a196-acac0151eb5c of volume 571c5b6f-e71b-4ba8-95da-ec0c80b01db5 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:25:33 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e6d1c5d-c964-4842-9209-1a3eadc97c11]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:25:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6ee91be0-5b1c-44f0-bca6-a2382af1eca8 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:33 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5 Jul 09 10:25:33 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:33 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6ee91be0-5b1c-44f0-bca6-a2382af1eca8 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5" returned: 0 in 0.753s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6ee91be0-5b1c-44f0-bca6-a2382af1eca8 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.ce1a72be-fdf1-42a7-a196-acac0151eb5c 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:33 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.ce1a72be-fdf1-42a7-a196-acac0151eb5c 1G Jul 09 10:25:33 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:34 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6ee91be0-5b1c-44f0-bca6-a2382af1eca8 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.ce1a72be-fdf1-42a7-a196-acac0151eb5c 1G" returned: 0 in 0.790s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6ee91be0-5b1c-44f0-bca6-a2382af1eca8 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.ce1a72be-fdf1-42a7-a196-acac0151eb5c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:34 devstack sudo[107690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.ce1a72be-fdf1-42a7-a196-acac0151eb5c Jul 09 10:25:34 devstack sudo[107690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:35 devstack sudo[107690]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6ee91be0-5b1c-44f0-bca6-a2382af1eca8 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.ce1a72be-fdf1-42a7-a196-acac0151eb5c" returned: 0 in 0.676s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:35 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-6ee91be0-5b1c-44f0-bca6-a2382af1eca8 tempest-ProjectMemberTests-643462856 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.ce1a72be-fdf1-42a7-a196-acac0151eb5c is being set with open permissions: ugo+rw Jul 09 10:25:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6ee91be0-5b1c-44f0-bca6-a2382af1eca8 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.ce1a72be-fdf1-42a7-a196-acac0151eb5c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:35 devstack sudo[107695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.ce1a72be-fdf1-42a7-a196-acac0151eb5c Jul 09 10:25:35 devstack sudo[107695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:35 devstack sudo[107695]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6ee91be0-5b1c-44f0-bca6-a2382af1eca8 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.ce1a72be-fdf1-42a7-a196-acac0151eb5c" returned: 0 in 0.628s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6ee91be0-5b1c-44f0-bca6-a2382af1eca8 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:35 devstack sudo[107698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.info Jul 09 10:25:35 devstack sudo[107698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:36 devstack sudo[107698]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6ee91be0-5b1c-44f0-bca6-a2382af1eca8 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.info" returned: 0 in 0.650s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:36 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-6ee91be0-5b1c-44f0-bca6-a2382af1eca8 tempest-ProjectMemberTests-643462856 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.info is being set with open permissions: ugo+rw Jul 09 10:25:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6ee91be0-5b1c-44f0-bca6-a2382af1eca8 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:36 devstack sudo[107701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.info Jul 09 10:25:36 devstack sudo[107701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:37 devstack sudo[107701]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6ee91be0-5b1c-44f0-bca6-a2382af1eca8 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.info" returned: 0 in 0.674s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6ee91be0-5b1c-44f0-bca6-a2382af1eca8 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.263s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:25:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6ee91be0-5b1c-44f0-bca6-a2382af1eca8 tempest-ProjectMemberTests-643462856 None] Create snapshot completed successfully Jul 09 10:25:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-ce1a72be-fdf1-42a7-a196-acac0151eb5c-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] Lock "cinder-ce1a72be-fdf1-42a7-a196-acac0151eb5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-571c5b6f-e71b-4ba8-95da-ec0c80b01db5" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-571c5b6f-e71b-4ba8-95da-ec0c80b01db5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-ce1a72be-fdf1-42a7-a196-acac0151eb5c" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-ce1a72be-fdf1-42a7-a196-acac0151eb5c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] Deleting offline snapshot ce1a72be-fdf1-42a7-a196-acac0151eb5c of volume 571c5b6f-e71b-4ba8-95da-ec0c80b01db5 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:25:38 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] snapshot_file for this snap is: volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.ce1a72be-fdf1-42a7-a196-acac0151eb5c {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:25:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[792ba27e-daa8-4cb0-804d-c09ed776b8cd]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:25:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.ce1a72be-fdf1-42a7-a196-acac0151eb5c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:38 devstack sudo[107740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.ce1a72be-fdf1-42a7-a196-acac0151eb5c Jul 09 10:25:38 devstack sudo[107740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:39 devstack sudo[107740]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.ce1a72be-fdf1-42a7-a196-acac0151eb5c" returned: 0 in 0.731s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:39 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:25:39 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5bc1583-6f80-415b-8f9a-09dbbcb8bfa8]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:25:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:39 devstack sudo[107746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5 Jul 09 10:25:39 devstack sudo[107746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:39 devstack sudo[107746]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5" returned: 0 in 0.762s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.ce1a72be-fdf1-42a7-a196-acac0151eb5c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:39 devstack sudo[107751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.ce1a72be-fdf1-42a7-a196-acac0151eb5c Jul 09 10:25:39 devstack sudo[107751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:40 devstack sudo[107751]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.ce1a72be-fdf1-42a7-a196-acac0151eb5c" returned: 0 in 0.726s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.ce1a72be-fdf1-42a7-a196-acac0151eb5c {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:40 devstack sudo[107756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.ce1a72be-fdf1-42a7-a196-acac0151eb5c Jul 09 10:25:40 devstack sudo[107756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:41 devstack sudo[107756]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5.ce1a72be-fdf1-42a7-a196-acac0151eb5c" returned: 0 in 0.646s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-ce1a72be-fdf1-42a7-a196-acac0151eb5c" released by "_delete_snapshot" :: held 2.947s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-571c5b6f-e71b-4ba8-95da-ec0c80b01db5" released by "delete_snapshot" :: held 2.970s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:41 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] Created reservations ['9948a25c-1a26-426f-9451-8c6b721e8bc5', '2bfa2f5f-282a-4179-9ffa-b213dd5cc193', '05b082a8-62b0-48db-bd8e-108bded635fe', '2816d3c0-6245-4746-963f-b9339041c368'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:25:41 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] Delete snapshot completed successfully. Jul 09 10:25:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-452f377f-0f57-4f96-b242-d48feaf26107 tempest-ProjectMemberTests-643462856 None] Lock "cinder-ce1a72be-fdf1-42a7-a196-acac0151eb5c-delete_snapshot" released by "delete_snapshot" :: held 3.100s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1d167aac-c7bf-435d-8cf8-ba4a2dba5dc8 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-571c5b6f-e71b-4ba8-95da-ec0c80b01db5-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1d167aac-c7bf-435d-8cf8-ba4a2dba5dc8 tempest-ProjectMemberTests-643462856 None] Lock "cinder-571c5b6f-e71b-4ba8-95da-ec0c80b01db5-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1d167aac-c7bf-435d-8cf8-ba4a2dba5dc8 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-571c5b6f-e71b-4ba8-95da-ec0c80b01db5" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1d167aac-c7bf-435d-8cf8-ba4a2dba5dc8 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-571c5b6f-e71b-4ba8-95da-ec0c80b01db5" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:41 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5423d34-4096-4e90-9431-b472ae311764]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:25:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1d167aac-c7bf-435d-8cf8-ba4a2dba5dc8 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:41 devstack sudo[107759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5 Jul 09 10:25:41 devstack sudo[107759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:42 devstack sudo[107759]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1d167aac-c7bf-435d-8cf8-ba4a2dba5dc8 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5" returned: 0 in 0.751s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1d167aac-c7bf-435d-8cf8-ba4a2dba5dc8 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:42 devstack sudo[107765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5 Jul 09 10:25:42 devstack sudo[107765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:42 devstack sudo[107765]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1d167aac-c7bf-435d-8cf8-ba4a2dba5dc8 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-571c5b6f-e71b-4ba8-95da-ec0c80b01db5" returned: 0 in 0.653s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:42 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1d167aac-c7bf-435d-8cf8-ba4a2dba5dc8 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-571c5b6f-e71b-4ba8-95da-ec0c80b01db5" released by "delete_volume" :: held 1.458s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:42 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-1d167aac-c7bf-435d-8cf8-ba4a2dba5dc8 tempest-ProjectMemberTests-643462856 None] Created reservations ['55106d2f-350f-47ac-b51b-a2df07e48d3b', '66f1063d-d5dd-472e-a40a-df3b90cbd7e4', '47d5da7a-2b42-43ae-bbff-08c31817fab6', '4790c591-d0f9-4573-992f-2e1704c4293f'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:25:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1d167aac-c7bf-435d-8cf8-ba4a2dba5dc8 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1d167aac-c7bf-435d-8cf8-ba4a2dba5dc8 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1d167aac-c7bf-435d-8cf8-ba4a2dba5dc8 tempest-ProjectMemberTests-643462856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:25:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1d167aac-c7bf-435d-8cf8-ba4a2dba5dc8 tempest-ProjectMemberTests-643462856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:25:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1d167aac-c7bf-435d-8cf8-ba4a2dba5dc8 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:25:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1d167aac-c7bf-435d-8cf8-ba4a2dba5dc8 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:43 devstack sudo[107768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:25:43 devstack sudo[107768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:43 devstack sudo[107768]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1d167aac-c7bf-435d-8cf8-ba4a2dba5dc8 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.696s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:43 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-1d167aac-c7bf-435d-8cf8-ba4a2dba5dc8 tempest-ProjectMemberTests-643462856 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:25:43 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1d167aac-c7bf-435d-8cf8-ba4a2dba5dc8 tempest-ProjectMemberTests-643462856 None] Deleted volume successfully. Jul 09 10:25:43 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1d167aac-c7bf-435d-8cf8-ba4a2dba5dc8 tempest-ProjectMemberTests-643462856 None] Lock "cinder-571c5b6f-e71b-4ba8-95da-ec0c80b01db5-delete_volume" released by "delete_volume" :: held 2.347s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Flow 'volume_create_manager' (7b54dd08-241b-46c8-9563-911b01d71c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12663a5f-c062-4cea-b2aa-2d79dc35d517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (12663a5f-c062-4cea-b2aa-2d79dc35d517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-177135711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8542d9-adf7-43dd-9525-b0b2df934700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12458de7c7c430393d29923401ca96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:25:44Z,use_quota=True,user_id='f8a913eedb0a421c8ab342bed701c8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93260606-b879-4184-b37a-969aaa43fe65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93260606-b879-4184-b37a-969aaa43fe65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e387a1d-a90d-417e-97fc-caf98e6c57d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e387a1d-a90d-417e-97fc-caf98e6c57d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad8542d9-adf7-43dd-9525-b0b2df934700', 'volume_name': 'volume-ad8542d9-adf7-43dd-9525-b0b2df934700', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ef22a7-187f-4fed-b12f-c1f745ec6c4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48ef22a7-187f-4fed-b12f-c1f745ec6c4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32fb62b-7f3b-426c-bac8-c0f1ff1a828b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:44 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Volume ad8542d9-adf7-43dd-9525-b0b2df934700: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad8542d9-adf7-43dd-9525-b0b2df934700', 'volume_size': 1} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:25:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-177135711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad8542d9-adf7-43dd-9525-b0b2df934700,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12458de7c7c430393d29923401ca96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:25:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:25:44Z,use_quota=True,user_id='f8a913eedb0a421c8ab342bed701c8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Creating volume ad8542d9-adf7-43dd-9525-b0b2df934700 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:25:44 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:25:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:44 devstack sudo[107777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700 1073741824 Jul 09 10:25:44 devstack sudo[107777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:45 devstack sudo[107777]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700 1073741824" returned: 0 in 0.830s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:45 devstack sudo[107782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700 Jul 09 10:25:45 devstack sudo[107782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:45 devstack sudo[107782]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700" returned: 0 in 0.646s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] <== create_volume: return (1521ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:25:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.524s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:25:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32fb62b-7f3b-426c-bac8-c0f1ff1a828b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad8542d9-adf7-43dd-9525-b0b2df934700', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1698b567-f3b5-40e6-88bc-2defc8fcde0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:45 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Volume volume-ad8542d9-adf7-43dd-9525-b0b2df934700 (ad8542d9-adf7-43dd-9525-b0b2df934700): created successfully Jul 09 10:25:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1698b567-f3b5-40e6-88bc-2defc8fcde0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Flow 'volume_create_manager' (7b54dd08-241b-46c8-9563-911b01d71c68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:25:45 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b9ce7531-43bc-410a-bc16-84bf47c74db7 tempest-ProjectMemberTests-643462856 None] Created volume successfully. Jul 09 10:25:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dc77d5d4-bae7-40db-973a-1675e244e599 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dc77d5d4-bae7-40db-973a-1675e244e599 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:46 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-dc77d5d4-bae7-40db-973a-1675e244e599 tempest-ProjectMemberTests-643462856 None] Creating offline snapshot b1aa40eb-658b-4c56-bbf3-bcda9b134db8 of volume ad8542d9-adf7-43dd-9525-b0b2df934700 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:25:46 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ac4fa8e-f99e-4c74-9b67-9feaf2117696]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:25:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc77d5d4-bae7-40db-973a-1675e244e599 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:46 devstack sudo[107786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700 Jul 09 10:25:46 devstack sudo[107786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:47 devstack sudo[107786]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc77d5d4-bae7-40db-973a-1675e244e599 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700" returned: 0 in 0.734s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc77d5d4-bae7-40db-973a-1675e244e599 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.b1aa40eb-658b-4c56-bbf3-bcda9b134db8 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:47 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.b1aa40eb-658b-4c56-bbf3-bcda9b134db8 1G Jul 09 10:25:47 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:47 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc77d5d4-bae7-40db-973a-1675e244e599 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.b1aa40eb-658b-4c56-bbf3-bcda9b134db8 1G" returned: 0 in 0.756s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc77d5d4-bae7-40db-973a-1675e244e599 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad8542d9-adf7-43dd-9525-b0b2df934700 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.b1aa40eb-658b-4c56-bbf3-bcda9b134db8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:47 devstack sudo[107796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad8542d9-adf7-43dd-9525-b0b2df934700 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.b1aa40eb-658b-4c56-bbf3-bcda9b134db8 Jul 09 10:25:47 devstack sudo[107796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:48 devstack sudo[107796]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc77d5d4-bae7-40db-973a-1675e244e599 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad8542d9-adf7-43dd-9525-b0b2df934700 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.b1aa40eb-658b-4c56-bbf3-bcda9b134db8" returned: 0 in 0.647s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:48 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-dc77d5d4-bae7-40db-973a-1675e244e599 tempest-ProjectMemberTests-643462856 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.b1aa40eb-658b-4c56-bbf3-bcda9b134db8 is being set with open permissions: ugo+rw Jul 09 10:25:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc77d5d4-bae7-40db-973a-1675e244e599 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.b1aa40eb-658b-4c56-bbf3-bcda9b134db8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:48 devstack sudo[107802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.b1aa40eb-658b-4c56-bbf3-bcda9b134db8 Jul 09 10:25:48 devstack sudo[107802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:49 devstack sudo[107802]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc77d5d4-bae7-40db-973a-1675e244e599 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.b1aa40eb-658b-4c56-bbf3-bcda9b134db8" returned: 0 in 0.633s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc77d5d4-bae7-40db-973a-1675e244e599 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:49 devstack sudo[107805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.info Jul 09 10:25:49 devstack sudo[107805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:49 devstack sudo[107805]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc77d5d4-bae7-40db-973a-1675e244e599 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.info" returned: 0 in 0.637s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:49 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-dc77d5d4-bae7-40db-973a-1675e244e599 tempest-ProjectMemberTests-643462856 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.info is being set with open permissions: ugo+rw Jul 09 10:25:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc77d5d4-bae7-40db-973a-1675e244e599 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:49 devstack sudo[107808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.info Jul 09 10:25:49 devstack sudo[107808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:50 devstack sudo[107808]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-dc77d5d4-bae7-40db-973a-1675e244e599 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.info" returned: 0 in 0.634s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-dc77d5d4-bae7-40db-973a-1675e244e599 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.124s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:25:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-dc77d5d4-bae7-40db-973a-1675e244e599 tempest-ProjectMemberTests-643462856 None] Create snapshot completed successfully Jul 09 10:25:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-b1aa40eb-658b-4c56-bbf3-bcda9b134db8-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] Lock "cinder-b1aa40eb-658b-4c56-bbf3-bcda9b134db8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-ad8542d9-adf7-43dd-9525-b0b2df934700" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-ad8542d9-adf7-43dd-9525-b0b2df934700" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-b1aa40eb-658b-4c56-bbf3-bcda9b134db8" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-b1aa40eb-658b-4c56-bbf3-bcda9b134db8" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] Deleting offline snapshot b1aa40eb-658b-4c56-bbf3-bcda9b134db8 of volume ad8542d9-adf7-43dd-9525-b0b2df934700 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:25:51 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] snapshot_file for this snap is: volume-ad8542d9-adf7-43dd-9525-b0b2df934700.b1aa40eb-658b-4c56-bbf3-bcda9b134db8 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:25:51 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[abac04f6-1894-4372-80ef-bdf602e2af6e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:25:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.b1aa40eb-658b-4c56-bbf3-bcda9b134db8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:51 devstack sudo[107811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.b1aa40eb-658b-4c56-bbf3-bcda9b134db8 Jul 09 10:25:51 devstack sudo[107811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:52 devstack sudo[107811]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.b1aa40eb-658b-4c56-bbf3-bcda9b134db8" returned: 0 in 0.747s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad8542d9-adf7-43dd-9525-b0b2df934700(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:25:52 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0566e368-1d4a-49e9-b354-06fd0e169555]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:25:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:52 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700 Jul 09 10:25:52 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:53 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700" returned: 0 in 0.733s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.b1aa40eb-658b-4c56-bbf3-bcda9b134db8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:53 devstack sudo[107821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.b1aa40eb-658b-4c56-bbf3-bcda9b134db8 Jul 09 10:25:53 devstack sudo[107821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:53 devstack sudo[107821]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.b1aa40eb-658b-4c56-bbf3-bcda9b134db8" returned: 0 in 0.704s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.b1aa40eb-658b-4c56-bbf3-bcda9b134db8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:53 devstack sudo[107826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.b1aa40eb-658b-4c56-bbf3-bcda9b134db8 Jul 09 10:25:53 devstack sudo[107826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:54 devstack sudo[107826]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700.b1aa40eb-658b-4c56-bbf3-bcda9b134db8" returned: 0 in 0.640s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-b1aa40eb-658b-4c56-bbf3-bcda9b134db8" released by "_delete_snapshot" :: held 2.910s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-ad8542d9-adf7-43dd-9525-b0b2df934700" released by "delete_snapshot" :: held 2.931s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:54 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] Created reservations ['eadd3fe3-55da-400d-9c5c-ee4734da4ca1', 'e72032e7-1298-4631-80ad-3314a9675bf6', '23927a70-7ad4-4b60-926f-d765ffa071aa', '291f14a7-c0c3-442d-8341-87fb5533b317'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:25:54 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] Delete snapshot completed successfully. Jul 09 10:25:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-3bc70faa-42e2-4aa5-806c-a9fb411e829b tempest-ProjectMemberTests-643462856 None] Lock "cinder-b1aa40eb-658b-4c56-bbf3-bcda9b134db8-delete_snapshot" released by "delete_snapshot" :: held 3.053s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8ea6e87f-b196-46cd-8bda-6fc5af22275d tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-ad8542d9-adf7-43dd-9525-b0b2df934700-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8ea6e87f-b196-46cd-8bda-6fc5af22275d tempest-ProjectMemberTests-643462856 None] Lock "cinder-ad8542d9-adf7-43dd-9525-b0b2df934700-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8ea6e87f-b196-46cd-8bda-6fc5af22275d tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-ad8542d9-adf7-43dd-9525-b0b2df934700" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:25:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8ea6e87f-b196-46cd-8bda-6fc5af22275d tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-ad8542d9-adf7-43dd-9525-b0b2df934700" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:25:54 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e2d061d-32c3-43f6-9eab-de8ba1ca6783]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:25:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8ea6e87f-b196-46cd-8bda-6fc5af22275d tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:54 devstack sudo[107829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700 Jul 09 10:25:54 devstack sudo[107829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:55 devstack sudo[107829]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8ea6e87f-b196-46cd-8bda-6fc5af22275d tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700" returned: 0 in 0.734s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8ea6e87f-b196-46cd-8bda-6fc5af22275d tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:55 devstack sudo[107834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700 Jul 09 10:25:55 devstack sudo[107834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:56 devstack sudo[107834]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8ea6e87f-b196-46cd-8bda-6fc5af22275d tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-ad8542d9-adf7-43dd-9525-b0b2df934700" returned: 0 in 0.629s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:56 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8ea6e87f-b196-46cd-8bda-6fc5af22275d tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-ad8542d9-adf7-43dd-9525-b0b2df934700" released by "delete_volume" :: held 1.419s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:56 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-8ea6e87f-b196-46cd-8bda-6fc5af22275d tempest-ProjectMemberTests-643462856 None] Created reservations ['423155b9-c856-4e73-bba9-d7edb22948b6', '57f8d0ab-84c2-4261-92a5-f57d8b36a6e4', '830ffa5a-cc7d-4b25-95a4-8395ce2b465e', '00d23a63-2f5b-439e-8a85-1a46c2569641'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:25:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8ea6e87f-b196-46cd-8bda-6fc5af22275d tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8ea6e87f-b196-46cd-8bda-6fc5af22275d tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8ea6e87f-b196-46cd-8bda-6fc5af22275d tempest-ProjectMemberTests-643462856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:25:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-8ea6e87f-b196-46cd-8bda-6fc5af22275d tempest-ProjectMemberTests-643462856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:25:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-8ea6e87f-b196-46cd-8bda-6fc5af22275d tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:25:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8ea6e87f-b196-46cd-8bda-6fc5af22275d tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:56 devstack sudo[107837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:25:56 devstack sudo[107837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:56 devstack sudo[107837]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-8ea6e87f-b196-46cd-8bda-6fc5af22275d tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.640s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:56 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-8ea6e87f-b196-46cd-8bda-6fc5af22275d tempest-ProjectMemberTests-643462856 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:25:56 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-8ea6e87f-b196-46cd-8bda-6fc5af22275d tempest-ProjectMemberTests-643462856 None] Deleted volume successfully. Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-8ea6e87f-b196-46cd-8bda-6fc5af22275d tempest-ProjectMemberTests-643462856 None] Lock "cinder-ad8542d9-adf7-43dd-9525-b0b2df934700-delete_volume" released by "delete_volume" :: held 2.311s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Flow 'volume_create_manager' (dc54ea37-eee0-41eb-b122-82e64845466d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d253b1-49d4-4667-baf2-f411cf5fd606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a0d253b1-49d4-4667-baf2-f411cf5fd606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1483576686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e54b2f-ab95-4b76-8fbd-81d011a732ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12458de7c7c430393d29923401ca96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:25:57Z,use_quota=True,user_id='f8a913eedb0a421c8ab342bed701c8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3088cbd8-726c-427f-b52d-a7566041534d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3088cbd8-726c-427f-b52d-a7566041534d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daeaff9b-dcc1-45cf-a27d-b70fb814f679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (daeaff9b-dcc1-45cf-a27d-b70fb814f679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41e54b2f-ab95-4b76-8fbd-81d011a732ca', 'volume_name': 'volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2964ae87-a5f7-4a8c-a1bd-456d1d6827d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2964ae87-a5f7-4a8c-a1bd-456d1d6827d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfddcacb-4c02-4a51-8472-eb9c40459772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:57 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Volume 41e54b2f-ab95-4b76-8fbd-81d011a732ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca', 'volume_size': 1} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1483576686',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41e54b2f-ab95-4b76-8fbd-81d011a732ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f12458de7c7c430393d29923401ca96e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:25:57Z,use_quota=True,user_id='f8a913eedb0a421c8ab342bed701c8f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Creating volume 41e54b2f-ab95-4b76-8fbd-81d011a732ca {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:25:57 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:25:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:57 devstack sudo[107840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca 1073741824 Jul 09 10:25:57 devstack sudo[107840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:58 devstack sudo[107840]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca 1073741824" returned: 0 in 0.772s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:58 devstack sudo[107845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca Jul 09 10:25:58 devstack sudo[107845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:25:58 devstack sudo[107845]: pam_unix(sudo:session): session closed for user root Jul 09 10:25:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca" returned: 0 in 0.635s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:25:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:25:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.449s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:25:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bfddcacb-4c02-4a51-8472-eb9c40459772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142860a7-5c5f-4ad3-ac5a-890774217b73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:25:58 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Volume volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca (41e54b2f-ab95-4b76-8fbd-81d011a732ca): created successfully Jul 09 10:25:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (142860a7-5c5f-4ad3-ac5a-890774217b73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:25:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Flow 'volume_create_manager' (dc54ea37-eee0-41eb-b122-82e64845466d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:25:58 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a477bfa8-fd00-4c6b-a938-617fae1ed8b4 tempest-ProjectMemberTests-643462856 None] Created volume successfully. Jul 09 10:25:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9a22a053-c81f-4728-bfcf-6ad3e8fcad83 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:25:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9a22a053-c81f-4728-bfcf-6ad3e8fcad83 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:25:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9a22a053-c81f-4728-bfcf-6ad3e8fcad83 tempest-ProjectMemberTests-643462856 None] Creating offline snapshot 9a42caef-6001-49e1-861d-bf6ad6b19eb4 of volume 41e54b2f-ab95-4b76-8fbd-81d011a732ca {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:25:59 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0383b7c4-a032-4115-9796-5c8b85dc1954]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:25:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a22a053-c81f-4728-bfcf-6ad3e8fcad83 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:25:59 devstack sudo[107849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca Jul 09 10:25:59 devstack sudo[107849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:00 devstack sudo[107849]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a22a053-c81f-4728-bfcf-6ad3e8fcad83 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca" returned: 0 in 0.776s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a22a053-c81f-4728-bfcf-6ad3e8fcad83 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.9a42caef-6001-49e1-861d-bf6ad6b19eb4 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:00 devstack sudo[107854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.9a42caef-6001-49e1-861d-bf6ad6b19eb4 1G Jul 09 10:26:00 devstack sudo[107854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:01 devstack sudo[107854]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a22a053-c81f-4728-bfcf-6ad3e8fcad83 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.9a42caef-6001-49e1-861d-bf6ad6b19eb4 1G" returned: 0 in 0.768s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a22a053-c81f-4728-bfcf-6ad3e8fcad83 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.9a42caef-6001-49e1-861d-bf6ad6b19eb4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:01 devstack sudo[107859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.9a42caef-6001-49e1-861d-bf6ad6b19eb4 Jul 09 10:26:01 devstack sudo[107859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:01 devstack sudo[107859]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a22a053-c81f-4728-bfcf-6ad3e8fcad83 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.9a42caef-6001-49e1-861d-bf6ad6b19eb4" returned: 0 in 0.663s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:01 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-9a22a053-c81f-4728-bfcf-6ad3e8fcad83 tempest-ProjectMemberTests-643462856 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.9a42caef-6001-49e1-861d-bf6ad6b19eb4 is being set with open permissions: ugo+rw Jul 09 10:26:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a22a053-c81f-4728-bfcf-6ad3e8fcad83 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.9a42caef-6001-49e1-861d-bf6ad6b19eb4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:01 devstack sudo[107864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.9a42caef-6001-49e1-861d-bf6ad6b19eb4 Jul 09 10:26:01 devstack sudo[107864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:02 devstack sudo[107864]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a22a053-c81f-4728-bfcf-6ad3e8fcad83 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.9a42caef-6001-49e1-861d-bf6ad6b19eb4" returned: 0 in 0.646s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a22a053-c81f-4728-bfcf-6ad3e8fcad83 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:02 devstack sudo[107868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.info Jul 09 10:26:02 devstack sudo[107868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:03 devstack sudo[107868]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a22a053-c81f-4728-bfcf-6ad3e8fcad83 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.info" returned: 0 in 0.623s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:03 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-9a22a053-c81f-4728-bfcf-6ad3e8fcad83 tempest-ProjectMemberTests-643462856 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.info is being set with open permissions: ugo+rw Jul 09 10:26:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a22a053-c81f-4728-bfcf-6ad3e8fcad83 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:03 devstack sudo[107871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.info Jul 09 10:26:03 devstack sudo[107871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:03 devstack sudo[107871]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9a22a053-c81f-4728-bfcf-6ad3e8fcad83 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.info" returned: 0 in 0.619s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9a22a053-c81f-4728-bfcf-6ad3e8fcad83 tempest-ProjectMemberTests-643462856 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.172s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:26:03 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9a22a053-c81f-4728-bfcf-6ad3e8fcad83 tempest-ProjectMemberTests-643462856 None] Create snapshot completed successfully Jul 09 10:26:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-9a42caef-6001-49e1-861d-bf6ad6b19eb4-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:26:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] Lock "cinder-9a42caef-6001-49e1-861d-bf6ad6b19eb4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:26:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-41e54b2f-ab95-4b76-8fbd-81d011a732ca" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:26:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-41e54b2f-ab95-4b76-8fbd-81d011a732ca" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:26:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-9a42caef-6001-49e1-861d-bf6ad6b19eb4" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:26:04 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-9a42caef-6001-49e1-861d-bf6ad6b19eb4" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:26:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] Deleting offline snapshot 9a42caef-6001-49e1-861d-bf6ad6b19eb4 of volume 41e54b2f-ab95-4b76-8fbd-81d011a732ca {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:26:04 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] snapshot_file for this snap is: volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.9a42caef-6001-49e1-861d-bf6ad6b19eb4 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:26:04 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a895e1-a482-4480-a6ca-5eb994a8999c]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:26:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.9a42caef-6001-49e1-861d-bf6ad6b19eb4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:05 devstack sudo[107876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.9a42caef-6001-49e1-861d-bf6ad6b19eb4 Jul 09 10:26:05 devstack sudo[107876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:05 devstack sudo[107876]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.9a42caef-6001-49e1-861d-bf6ad6b19eb4" returned: 0 in 0.733s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:05 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:26:05 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed578887-61f4-4d5c-b2e9-0d8bf622ced6]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:26:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:05 devstack sudo[107881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca Jul 09 10:26:05 devstack sudo[107881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:06 devstack sudo[107881]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca" returned: 0 in 0.719s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.9a42caef-6001-49e1-861d-bf6ad6b19eb4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:06 devstack sudo[107887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.9a42caef-6001-49e1-861d-bf6ad6b19eb4 Jul 09 10:26:06 devstack sudo[107887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:07 devstack sudo[107887]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.9a42caef-6001-49e1-861d-bf6ad6b19eb4" returned: 0 in 0.703s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.9a42caef-6001-49e1-861d-bf6ad6b19eb4 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:07 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.9a42caef-6001-49e1-861d-bf6ad6b19eb4 Jul 09 10:26:07 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:07 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca.9a42caef-6001-49e1-861d-bf6ad6b19eb4" returned: 0 in 0.634s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-9a42caef-6001-49e1-861d-bf6ad6b19eb4" released by "_delete_snapshot" :: held 2.876s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:26:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-41e54b2f-ab95-4b76-8fbd-81d011a732ca" released by "delete_snapshot" :: held 2.900s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:26:07 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] Created reservations ['c377d124-a8f8-4ff8-aede-3e83365b7500', '9599634d-5515-41d4-a404-722f21cacf73', 'ce1ded4c-1c33-419f-90c7-9b5ce7becee1', 'f7241665-b8cd-4a5c-afb1-0080c8a3bb09'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:26:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] Delete snapshot completed successfully. Jul 09 10:26:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-d4e1cc2b-989a-4380-bb11-12a3f7153515 tempest-ProjectMemberTests-643462856 None] Lock "cinder-9a42caef-6001-49e1-861d-bf6ad6b19eb4-delete_snapshot" released by "delete_snapshot" :: held 3.026s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:26:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9565be4d-c9e5-4b66-b4b9-4ac5bc417592 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-41e54b2f-ab95-4b76-8fbd-81d011a732ca-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:26:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9565be4d-c9e5-4b66-b4b9-4ac5bc417592 tempest-ProjectMemberTests-643462856 None] Lock "cinder-41e54b2f-ab95-4b76-8fbd-81d011a732ca-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:26:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9565be4d-c9e5-4b66-b4b9-4ac5bc417592 tempest-ProjectMemberTests-643462856 None] Acquiring lock "cinder-quobyte-41e54b2f-ab95-4b76-8fbd-81d011a732ca" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:26:08 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9565be4d-c9e5-4b66-b4b9-4ac5bc417592 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-41e54b2f-ab95-4b76-8fbd-81d011a732ca" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:26:08 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[0682c098-97aa-4b09-af54-9158cd2fc378]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:26:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9565be4d-c9e5-4b66-b4b9-4ac5bc417592 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:08 devstack sudo[107895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca Jul 09 10:26:08 devstack sudo[107895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:08 devstack sudo[107895]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9565be4d-c9e5-4b66-b4b9-4ac5bc417592 tempest-ProjectMemberTests-643462856 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca" returned: 0 in 0.756s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9565be4d-c9e5-4b66-b4b9-4ac5bc417592 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:08 devstack sudo[107901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca Jul 09 10:26:09 devstack sudo[107901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:09 devstack sudo[107901]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9565be4d-c9e5-4b66-b4b9-4ac5bc417592 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-41e54b2f-ab95-4b76-8fbd-81d011a732ca" returned: 0 in 0.661s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:09 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9565be4d-c9e5-4b66-b4b9-4ac5bc417592 tempest-ProjectMemberTests-643462856 None] Lock "cinder-quobyte-41e54b2f-ab95-4b76-8fbd-81d011a732ca" released by "delete_volume" :: held 1.481s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:26:09 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-9565be4d-c9e5-4b66-b4b9-4ac5bc417592 tempest-ProjectMemberTests-643462856 None] Created reservations ['19fbdc1d-1a43-493d-9d79-8588416c0d4f', '99157c8a-0564-4402-a8b7-2fcace5dce14', '52ef89f7-3b66-42e1-89fb-6c333eb34693', '9d5ef77e-73eb-499c-a5c8-c43ff09cc847'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:26:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9565be4d-c9e5-4b66-b4b9-4ac5bc417592 tempest-ProjectMemberTests-643462856 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:26:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9565be4d-c9e5-4b66-b4b9-4ac5bc417592 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:26:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9565be4d-c9e5-4b66-b4b9-4ac5bc417592 tempest-ProjectMemberTests-643462856 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:26:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9565be4d-c9e5-4b66-b4b9-4ac5bc417592 tempest-ProjectMemberTests-643462856 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:26:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9565be4d-c9e5-4b66-b4b9-4ac5bc417592 tempest-ProjectMemberTests-643462856 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:26:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9565be4d-c9e5-4b66-b4b9-4ac5bc417592 tempest-ProjectMemberTests-643462856 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:09 devstack sudo[107904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:26:09 devstack sudo[107904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:10 devstack sudo[107904]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9565be4d-c9e5-4b66-b4b9-4ac5bc417592 tempest-ProjectMemberTests-643462856 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.660s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:10 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-9565be4d-c9e5-4b66-b4b9-4ac5bc417592 tempest-ProjectMemberTests-643462856 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:26:10 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9565be4d-c9e5-4b66-b4b9-4ac5bc417592 tempest-ProjectMemberTests-643462856 None] Deleted volume successfully. Jul 09 10:26:10 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9565be4d-c9e5-4b66-b4b9-4ac5bc417592 tempest-ProjectMemberTests-643462856 None] Lock "cinder-41e54b2f-ab95-4b76-8fbd-81d011a732ca-delete_volume" released by "delete_volume" :: held 2.328s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Flow 'volume_create_manager' (a88c02a7-15e3-42e0-b938-8e0887f4b5a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47728bd-85ee-4f9c-81bc-f5a6935c114e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e47728bd-85ee-4f9c-81bc-f5a6935c114e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-86948456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0444bd-27f9-4611-8fa6-df40422c6a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f20b13cc6242f6b7f2de64bdc252de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:26:14Z,use_quota=True,user_id='0c5f519648da49adad073456f049cb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b310d5f-cb4f-4481-97a0-ba92ce8f1c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b310d5f-cb4f-4481-97a0-ba92ce8f1c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f0ced6-d7be-45a6-96e0-39de4547bdb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8f0ced6-d7be-45a6-96e0-39de4547bdb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f0444bd-27f9-4611-8fa6-df40422c6a11', 'volume_name': 'volume-8f0444bd-27f9-4611-8fa6-df40422c6a11', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977f053a-1153-4b58-80ec-e5fa21717610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (977f053a-1153-4b58-80ec-e5fa21717610) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0076ed0-510f-4fc6-a55c-48b16ed3a78b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:13 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Volume 8f0444bd-27f9-4611-8fa6-df40422c6a11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f0444bd-27f9-4611-8fa6-df40422c6a11', 'volume_size': 1} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:26:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-86948456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f0444bd-27f9-4611-8fa6-df40422c6a11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f20b13cc6242f6b7f2de64bdc252de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:26:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:26:14Z,use_quota=True,user_id='0c5f519648da49adad073456f049cb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Creating volume 8f0444bd-27f9-4611-8fa6-df40422c6a11 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:26:13 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:26:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:14 devstack sudo[107910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11 1073741824 Jul 09 10:26:14 devstack sudo[107910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:14 devstack sudo[107910]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11 1073741824" returned: 0 in 0.785s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:14 devstack sudo[107915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11 Jul 09 10:26:14 devstack sudo[107915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:15 devstack sudo[107915]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11" returned: 0 in 0.657s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] <== create_volume: return (1489ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:26:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:26:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0076ed0-510f-4fc6-a55c-48b16ed3a78b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f0444bd-27f9-4611-8fa6-df40422c6a11', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81fb2a4d-a7b2-4d51-9a28-4580e565e698) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:15 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Volume volume-8f0444bd-27f9-4611-8fa6-df40422c6a11 (8f0444bd-27f9-4611-8fa6-df40422c6a11): created successfully Jul 09 10:26:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (81fb2a4d-a7b2-4d51-9a28-4580e565e698) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:15 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Flow 'volume_create_manager' (a88c02a7-15e3-42e0-b938-8e0887f4b5a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:26:15 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-3ef088fc-953e-4d1a-9aa2-3857db90665e tempest-ProjectReaderTests-1053199021 None] Created volume successfully. Jul 09 10:26:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d4a7b2ac-a243-43bd-a40b-aaaca7a89764 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:26:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d4a7b2ac-a243-43bd-a40b-aaaca7a89764 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:26:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-d4a7b2ac-a243-43bd-a40b-aaaca7a89764 tempest-ProjectReaderTests-1053199021 None] Creating offline snapshot d20adf7b-62bc-4c27-a98e-2e04e9d03acf of volume 8f0444bd-27f9-4611-8fa6-df40422c6a11 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:26:16 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a12222a-669d-4c98-b181-c3d73beaede8]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:26:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4a7b2ac-a243-43bd-a40b-aaaca7a89764 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:16 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11 Jul 09 10:26:16 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:16 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4a7b2ac-a243-43bd-a40b-aaaca7a89764 tempest-ProjectReaderTests-1053199021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11" returned: 0 in 0.720s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4a7b2ac-a243-43bd-a40b-aaaca7a89764 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.d20adf7b-62bc-4c27-a98e-2e04e9d03acf 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:16 devstack sudo[107923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.d20adf7b-62bc-4c27-a98e-2e04e9d03acf 1G Jul 09 10:26:16 devstack sudo[107923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:17 devstack sudo[107923]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4a7b2ac-a243-43bd-a40b-aaaca7a89764 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.d20adf7b-62bc-4c27-a98e-2e04e9d03acf 1G" returned: 0 in 0.795s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4a7b2ac-a243-43bd-a40b-aaaca7a89764 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0444bd-27f9-4611-8fa6-df40422c6a11 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.d20adf7b-62bc-4c27-a98e-2e04e9d03acf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:17 devstack sudo[107928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0444bd-27f9-4611-8fa6-df40422c6a11 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.d20adf7b-62bc-4c27-a98e-2e04e9d03acf Jul 09 10:26:17 devstack sudo[107928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:18 devstack sudo[107928]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4a7b2ac-a243-43bd-a40b-aaaca7a89764 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8f0444bd-27f9-4611-8fa6-df40422c6a11 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.d20adf7b-62bc-4c27-a98e-2e04e9d03acf" returned: 0 in 0.669s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:18 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-d4a7b2ac-a243-43bd-a40b-aaaca7a89764 tempest-ProjectReaderTests-1053199021 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.d20adf7b-62bc-4c27-a98e-2e04e9d03acf is being set with open permissions: ugo+rw Jul 09 10:26:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4a7b2ac-a243-43bd-a40b-aaaca7a89764 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.d20adf7b-62bc-4c27-a98e-2e04e9d03acf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:18 devstack sudo[107933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.d20adf7b-62bc-4c27-a98e-2e04e9d03acf Jul 09 10:26:18 devstack sudo[107933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:18 devstack sudo[107933]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4a7b2ac-a243-43bd-a40b-aaaca7a89764 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.d20adf7b-62bc-4c27-a98e-2e04e9d03acf" returned: 0 in 0.637s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4a7b2ac-a243-43bd-a40b-aaaca7a89764 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:19 devstack sudo[107937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.info Jul 09 10:26:19 devstack sudo[107937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:19 devstack sudo[107937]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4a7b2ac-a243-43bd-a40b-aaaca7a89764 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.info" returned: 0 in 0.632s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:19 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-d4a7b2ac-a243-43bd-a40b-aaaca7a89764 tempest-ProjectReaderTests-1053199021 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.info is being set with open permissions: ugo+rw Jul 09 10:26:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4a7b2ac-a243-43bd-a40b-aaaca7a89764 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:19 devstack sudo[107940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.info Jul 09 10:26:19 devstack sudo[107940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:20 devstack sudo[107940]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-d4a7b2ac-a243-43bd-a40b-aaaca7a89764 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.info" returned: 0 in 0.659s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-d4a7b2ac-a243-43bd-a40b-aaaca7a89764 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.187s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:26:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-d4a7b2ac-a243-43bd-a40b-aaaca7a89764 tempest-ProjectReaderTests-1053199021 None] Create snapshot completed successfully Jul 09 10:26:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-d20adf7b-62bc-4c27-a98e-2e04e9d03acf-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:26:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-d20adf7b-62bc-4c27-a98e-2e04e9d03acf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:26:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-quobyte-8f0444bd-27f9-4611-8fa6-df40422c6a11" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:26:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-8f0444bd-27f9-4611-8fa6-df40422c6a11" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:26:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-quobyte-d20adf7b-62bc-4c27-a98e-2e04e9d03acf" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:26:21 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-d20adf7b-62bc-4c27-a98e-2e04e9d03acf" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:26:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] Deleting offline snapshot d20adf7b-62bc-4c27-a98e-2e04e9d03acf of volume 8f0444bd-27f9-4611-8fa6-df40422c6a11 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:26:21 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] snapshot_file for this snap is: volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.d20adf7b-62bc-4c27-a98e-2e04e9d03acf {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:26:21 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[dbe2496f-3a40-4af9-9375-5e7245d67c20]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:26:21 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.d20adf7b-62bc-4c27-a98e-2e04e9d03acf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:21 devstack sudo[107943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.d20adf7b-62bc-4c27-a98e-2e04e9d03acf Jul 09 10:26:21 devstack sudo[107943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:22 devstack sudo[107943]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.d20adf7b-62bc-4c27-a98e-2e04e9d03acf" returned: 0 in 0.769s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:22 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8f0444bd-27f9-4611-8fa6-df40422c6a11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:26:22 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[168f8d10-e7cd-47a5-9813-7de23446015f]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:26:22 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:22 devstack sudo[107948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11 Jul 09 10:26:22 devstack sudo[107948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:23 devstack sudo[107948]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11" returned: 0 in 0.739s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.d20adf7b-62bc-4c27-a98e-2e04e9d03acf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:23 devstack sudo[107953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.d20adf7b-62bc-4c27-a98e-2e04e9d03acf Jul 09 10:26:23 devstack sudo[107953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:23 devstack sudo[107953]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.d20adf7b-62bc-4c27-a98e-2e04e9d03acf" returned: 0 in 0.712s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:23 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.d20adf7b-62bc-4c27-a98e-2e04e9d03acf {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:23 devstack sudo[107959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.d20adf7b-62bc-4c27-a98e-2e04e9d03acf Jul 09 10:26:23 devstack sudo[107959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:24 devstack sudo[107959]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11.d20adf7b-62bc-4c27-a98e-2e04e9d03acf" returned: 0 in 0.647s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-d20adf7b-62bc-4c27-a98e-2e04e9d03acf" released by "_delete_snapshot" :: held 2.950s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:26:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-8f0444bd-27f9-4611-8fa6-df40422c6a11" released by "delete_snapshot" :: held 2.970s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:26:24 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] Created reservations ['5a3a97fa-445c-4ac9-8e48-7330dc579e55', 'a056ba09-8aa0-41ce-adae-bc0c528ba399', '830699e8-c5d9-4be2-b22c-3a8f2c1290bf', '8a37e5ed-a0b8-4753-8e34-8d73e7e869b5'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:26:24 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] Delete snapshot completed successfully. Jul 09 10:26:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-6eb30a44-8af3-42bf-912e-de9a515a0c42 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-d20adf7b-62bc-4c27-a98e-2e04e9d03acf-delete_snapshot" released by "delete_snapshot" :: held 3.096s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:26:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b114cfef-4d16-4205-8964-b82a9645bb8c tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-8f0444bd-27f9-4611-8fa6-df40422c6a11-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:26:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b114cfef-4d16-4205-8964-b82a9645bb8c tempest-ProjectReaderTests-1053199021 None] Lock "cinder-8f0444bd-27f9-4611-8fa6-df40422c6a11-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:26:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b114cfef-4d16-4205-8964-b82a9645bb8c tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-quobyte-8f0444bd-27f9-4611-8fa6-df40422c6a11" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:26:24 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b114cfef-4d16-4205-8964-b82a9645bb8c tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-8f0444bd-27f9-4611-8fa6-df40422c6a11" acquired by "delete_volume" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:26:24 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4430511-309c-453b-8d06-bccb53393b72]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:26:24 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b114cfef-4d16-4205-8964-b82a9645bb8c tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:24 devstack sudo[107962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11 Jul 09 10:26:24 devstack sudo[107962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:25 devstack sudo[107962]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b114cfef-4d16-4205-8964-b82a9645bb8c tempest-ProjectReaderTests-1053199021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11" returned: 0 in 0.746s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:25 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b114cfef-4d16-4205-8964-b82a9645bb8c tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:25 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11 Jul 09 10:26:25 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:26 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b114cfef-4d16-4205-8964-b82a9645bb8c tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8f0444bd-27f9-4611-8fa6-df40422c6a11" returned: 0 in 0.624s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b114cfef-4d16-4205-8964-b82a9645bb8c tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-8f0444bd-27f9-4611-8fa6-df40422c6a11" released by "delete_volume" :: held 1.424s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:26:26 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-b114cfef-4d16-4205-8964-b82a9645bb8c tempest-ProjectReaderTests-1053199021 None] Created reservations ['238ab4d9-760a-4d8a-921e-fcd63fa9cc98', 'ffd0b2cf-5daa-42ac-9472-491315f03508', '20982cf0-359a-46c0-8e23-fc0ea62b2b3a', '0203d6d7-5a5e-4294-b08b-604bfdc789f6'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:26:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b114cfef-4d16-4205-8964-b82a9645bb8c tempest-ProjectReaderTests-1053199021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:26:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b114cfef-4d16-4205-8964-b82a9645bb8c tempest-ProjectReaderTests-1053199021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:26:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b114cfef-4d16-4205-8964-b82a9645bb8c tempest-ProjectReaderTests-1053199021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:26:26 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b114cfef-4d16-4205-8964-b82a9645bb8c tempest-ProjectReaderTests-1053199021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:26:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b114cfef-4d16-4205-8964-b82a9645bb8c tempest-ProjectReaderTests-1053199021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:26:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b114cfef-4d16-4205-8964-b82a9645bb8c tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:26 devstack sudo[107970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:26:26 devstack sudo[107970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:26 devstack sudo[107970]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:26 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b114cfef-4d16-4205-8964-b82a9645bb8c tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.621s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:26 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-b114cfef-4d16-4205-8964-b82a9645bb8c tempest-ProjectReaderTests-1053199021 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:26:26 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b114cfef-4d16-4205-8964-b82a9645bb8c tempest-ProjectReaderTests-1053199021 None] Deleted volume successfully. Jul 09 10:26:26 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-b114cfef-4d16-4205-8964-b82a9645bb8c tempest-ProjectReaderTests-1053199021 None] Lock "cinder-8f0444bd-27f9-4611-8fa6-df40422c6a11-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Flow 'volume_create_manager' (ae22e3e4-d7b6-451b-8a18-f55d803a8d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e81423-ae43-4014-94ef-d62ea998dc9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e81423-ae43-4014-94ef-d62ea998dc9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-681627417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e9eb74-7a13-4c31-a983-0fbcfda6f6b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f20b13cc6242f6b7f2de64bdc252de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:26:27Z,use_quota=True,user_id='0c5f519648da49adad073456f049cb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b5d845-c287-45d5-9849-93bb1c6f0857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (03b5d845-c287-45d5-9849-93bb1c6f0857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20aed498-6067-4336-b246-8f8db28ffcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20aed498-6067-4336-b246-8f8db28ffcc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72e9eb74-7a13-4c31-a983-0fbcfda6f6b8', 'volume_name': 'volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f49d3b9-3170-403f-b358-947995174f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3f49d3b9-3170-403f-b358-947995174f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e209632e-72ad-4ec7-ab83-b12711035230) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:27 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Volume 72e9eb74-7a13-4c31-a983-0fbcfda6f6b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8', 'volume_size': 1} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:26:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-681627417',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72e9eb74-7a13-4c31-a983-0fbcfda6f6b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f20b13cc6242f6b7f2de64bdc252de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:26:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:26:27Z,use_quota=True,user_id='0c5f519648da49adad073456f049cb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Creating volume 72e9eb74-7a13-4c31-a983-0fbcfda6f6b8 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:26:27 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:26:27 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:27 devstack sudo[107973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8 1073741824 Jul 09 10:26:27 devstack sudo[107973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:28 devstack sudo[107973]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8 1073741824" returned: 0 in 0.770s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:28 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8 Jul 09 10:26:28 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:28 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8" returned: 0 in 0.657s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:28 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] <== create_volume: return (1469ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:26:28 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:26:28 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=60,cinder:INSERT=18,cinder:UPDATE=78,cinder:DELETE=6 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:26:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e209632e-72ad-4ec7-ab83-b12711035230) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a52f02-e451-4aa0-bc64-65d0b093eecf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:28 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=66,cinder:INSERT=27,cinder:UPDATE=87,cinder:DELETE=7 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:26:28 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Volume volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8 (72e9eb74-7a13-4c31-a983-0fbcfda6f6b8): created successfully Jul 09 10:26:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83a52f02-e451-4aa0-bc64-65d0b093eecf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:28 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Flow 'volume_create_manager' (ae22e3e4-d7b6-451b-8a18-f55d803a8d99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:26:28 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-655d0f84-417f-408b-9584-fbdaa8d961b7 tempest-ProjectReaderTests-1053199021 None] Created volume successfully. Jul 09 10:26:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-998639e7-1b41-42f5-8c0d-95c30c77d32b tempest-ProjectReaderTests-1053199021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:26:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-998639e7-1b41-42f5-8c0d-95c30c77d32b tempest-ProjectReaderTests-1053199021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:26:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-998639e7-1b41-42f5-8c0d-95c30c77d32b tempest-ProjectReaderTests-1053199021 None] Creating offline snapshot e6cf54b2-9872-48b9-809e-e5af2e445da2 of volume 72e9eb74-7a13-4c31-a983-0fbcfda6f6b8 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:26:29 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[582328ea-177b-41c8-96ec-b0666543aae3]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:26:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-998639e7-1b41-42f5-8c0d-95c30c77d32b tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:29 devstack sudo[107983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8 Jul 09 10:26:29 devstack sudo[107983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:26:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:26:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:26:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:26:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:26:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:26:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:29 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:26:29 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:30 devstack sudo[107983]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-998639e7-1b41-42f5-8c0d-95c30c77d32b tempest-ProjectReaderTests-1053199021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8" returned: 0 in 0.767s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-998639e7-1b41-42f5-8c0d-95c30c77d32b tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.e6cf54b2-9872-48b9-809e-e5af2e445da2 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:30 devstack sudo[107990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.e6cf54b2-9872-48b9-809e-e5af2e445da2 1G Jul 09 10:26:30 devstack sudo[107990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:30 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.633s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:26:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:26:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:26:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:26:31 devstack sudo[107990]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-998639e7-1b41-42f5-8c0d-95c30c77d32b tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.e6cf54b2-9872-48b9-809e-e5af2e445da2 1G" returned: 0 in 0.768s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-998639e7-1b41-42f5-8c0d-95c30c77d32b tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.e6cf54b2-9872-48b9-809e-e5af2e445da2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:31 devstack sudo[107996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.e6cf54b2-9872-48b9-809e-e5af2e445da2 Jul 09 10:26:31 devstack sudo[107996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:31 devstack sudo[107996]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-998639e7-1b41-42f5-8c0d-95c30c77d32b tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.e6cf54b2-9872-48b9-809e-e5af2e445da2" returned: 0 in 0.707s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:31 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-998639e7-1b41-42f5-8c0d-95c30c77d32b tempest-ProjectReaderTests-1053199021 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.e6cf54b2-9872-48b9-809e-e5af2e445da2 is being set with open permissions: ugo+rw Jul 09 10:26:31 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-998639e7-1b41-42f5-8c0d-95c30c77d32b tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.e6cf54b2-9872-48b9-809e-e5af2e445da2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:31 devstack sudo[108001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.e6cf54b2-9872-48b9-809e-e5af2e445da2 Jul 09 10:26:31 devstack sudo[108001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:32 devstack sudo[108001]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-998639e7-1b41-42f5-8c0d-95c30c77d32b tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.e6cf54b2-9872-48b9-809e-e5af2e445da2" returned: 0 in 0.613s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:32 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-998639e7-1b41-42f5-8c0d-95c30c77d32b tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:32 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.info Jul 09 10:26:32 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:33 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-998639e7-1b41-42f5-8c0d-95c30c77d32b tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.info" returned: 0 in 0.647s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:33 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-998639e7-1b41-42f5-8c0d-95c30c77d32b tempest-ProjectReaderTests-1053199021 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.info is being set with open permissions: ugo+rw Jul 09 10:26:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-998639e7-1b41-42f5-8c0d-95c30c77d32b tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:33 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.info Jul 09 10:26:33 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:33 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-998639e7-1b41-42f5-8c0d-95c30c77d32b tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.info" returned: 0 in 0.621s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:33 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-998639e7-1b41-42f5-8c0d-95c30c77d32b tempest-ProjectReaderTests-1053199021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.196s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:26:33 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-998639e7-1b41-42f5-8c0d-95c30c77d32b tempest-ProjectReaderTests-1053199021 None] Create snapshot completed successfully Jul 09 10:26:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-e6cf54b2-9872-48b9-809e-e5af2e445da2-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:26:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-e6cf54b2-9872-48b9-809e-e5af2e445da2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:26:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-quobyte-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:26:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:26:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-quobyte-e6cf54b2-9872-48b9-809e-e5af2e445da2" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:26:34 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-e6cf54b2-9872-48b9-809e-e5af2e445da2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:26:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] Deleting offline snapshot e6cf54b2-9872-48b9-809e-e5af2e445da2 of volume 72e9eb74-7a13-4c31-a983-0fbcfda6f6b8 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:26:34 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] snapshot_file for this snap is: volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.e6cf54b2-9872-48b9-809e-e5af2e445da2 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:26:34 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[22f4fa4f-ff80-4baf-8c54-9177f9dc12b4]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:26:34 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.e6cf54b2-9872-48b9-809e-e5af2e445da2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:34 devstack sudo[108010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.e6cf54b2-9872-48b9-809e-e5af2e445da2 Jul 09 10:26:34 devstack sudo[108010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:35 devstack sudo[108010]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.e6cf54b2-9872-48b9-809e-e5af2e445da2" returned: 0 in 0.786s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:35 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:26:35 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c885190-8cb3-4f8e-9af5-5830a2dc384b]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:26:35 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:35 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8 Jul 09 10:26:35 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:36 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8" returned: 0 in 0.775s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:36 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.e6cf54b2-9872-48b9-809e-e5af2e445da2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:36 devstack sudo[108020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.e6cf54b2-9872-48b9-809e-e5af2e445da2 Jul 09 10:26:36 devstack sudo[108020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:37 devstack sudo[108020]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.e6cf54b2-9872-48b9-809e-e5af2e445da2" returned: 0 in 0.716s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.e6cf54b2-9872-48b9-809e-e5af2e445da2 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:37 devstack sudo[108025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.e6cf54b2-9872-48b9-809e-e5af2e445da2 Jul 09 10:26:37 devstack sudo[108025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:37 devstack sudo[108025]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:37 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8.e6cf54b2-9872-48b9-809e-e5af2e445da2" returned: 0 in 0.645s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-e6cf54b2-9872-48b9-809e-e5af2e445da2" released by "_delete_snapshot" :: held 3.013s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:26:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8" released by "delete_snapshot" :: held 3.034s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:26:37 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] Created reservations ['5c476947-3260-4275-b62b-32f6dfb81996', '6c15b774-2a0b-4a80-9704-9948d08fd7d5', '60545b37-4ec5-47cf-af65-a1acbef122e1', 'f7a00407-881e-462a-b1ce-aa3e71bf5f50'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:26:37 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] Delete snapshot completed successfully. Jul 09 10:26:37 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ff62e7bb-f593-4c6f-83ca-098db10281b1 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-e6cf54b2-9872-48b9-809e-e5af2e445da2-delete_snapshot" released by "delete_snapshot" :: held 3.162s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:26:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9f50356b-8f65-4c37-b4ba-32080bef1fca tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:26:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9f50356b-8f65-4c37-b4ba-32080bef1fca tempest-ProjectReaderTests-1053199021 None] Lock "cinder-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:26:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9f50356b-8f65-4c37-b4ba-32080bef1fca tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-quobyte-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:26:38 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9f50356b-8f65-4c37-b4ba-32080bef1fca tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:26:38 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2bdb092-fa64-4a14-b1c0-aa061d54a341]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:26:38 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f50356b-8f65-4c37-b4ba-32080bef1fca tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:39 devstack sudo[108065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8 Jul 09 10:26:39 devstack sudo[108065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:39 devstack sudo[108065]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f50356b-8f65-4c37-b4ba-32080bef1fca tempest-ProjectReaderTests-1053199021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8" returned: 0 in 0.791s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:39 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f50356b-8f65-4c37-b4ba-32080bef1fca tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:39 devstack sudo[108070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8 Jul 09 10:26:39 devstack sudo[108070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:40 devstack sudo[108070]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f50356b-8f65-4c37-b4ba-32080bef1fca tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8" returned: 0 in 0.664s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:40 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9f50356b-8f65-4c37-b4ba-32080bef1fca tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8" released by "delete_volume" :: held 1.508s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:26:40 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-9f50356b-8f65-4c37-b4ba-32080bef1fca tempest-ProjectReaderTests-1053199021 None] Created reservations ['63eee310-daa4-46ec-87c8-9921bf50b36a', '215a4783-60ba-483f-baee-174e7020b63a', '0f5dfb60-e4bc-4332-a10a-efb171940611', '8c6d6f3b-becb-4a9d-8a73-3e1cbdb42866'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:26:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9f50356b-8f65-4c37-b4ba-32080bef1fca tempest-ProjectReaderTests-1053199021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:26:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9f50356b-8f65-4c37-b4ba-32080bef1fca tempest-ProjectReaderTests-1053199021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:26:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9f50356b-8f65-4c37-b4ba-32080bef1fca tempest-ProjectReaderTests-1053199021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:26:40 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9f50356b-8f65-4c37-b4ba-32080bef1fca tempest-ProjectReaderTests-1053199021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:26:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9f50356b-8f65-4c37-b4ba-32080bef1fca tempest-ProjectReaderTests-1053199021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:26:40 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f50356b-8f65-4c37-b4ba-32080bef1fca tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:40 devstack sudo[108073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:26:40 devstack sudo[108073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:41 devstack sudo[108073]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9f50356b-8f65-4c37-b4ba-32080bef1fca tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.642s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-9f50356b-8f65-4c37-b4ba-32080bef1fca tempest-ProjectReaderTests-1053199021 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:26:41 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9f50356b-8f65-4c37-b4ba-32080bef1fca tempest-ProjectReaderTests-1053199021 None] Deleted volume successfully. Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-9f50356b-8f65-4c37-b4ba-32080bef1fca tempest-ProjectReaderTests-1053199021 None] Lock "cinder-72e9eb74-7a13-4c31-a983-0fbcfda6f6b8-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Flow 'volume_create_manager' (fcf2af02-652f-4c65-9ea9-c9db8491a438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08f9e2f-c668-470a-a4da-d73f1f84fb2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c08f9e2f-c668-470a-a4da-d73f1f84fb2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1897047337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24355536-0861-49b4-b653-2fc242e118fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f20b13cc6242f6b7f2de64bdc252de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:26:41Z,use_quota=True,user_id='0c5f519648da49adad073456f049cb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029bf438-54b0-48d0-bce1-50e8d4da49a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (029bf438-54b0-48d0-bce1-50e8d4da49a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244678fd-22fc-409e-9027-b86b1b1879c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (244678fd-22fc-409e-9027-b86b1b1879c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24355536-0861-49b4-b653-2fc242e118fe', 'volume_name': 'volume-24355536-0861-49b4-b653-2fc242e118fe', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d23f16-b21a-418c-8520-a9446f297d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6d23f16-b21a-418c-8520-a9446f297d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80cf8591-195c-4a85-b204-c8748893bb42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:41 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Volume 24355536-0861-49b4-b653-2fc242e118fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24355536-0861-49b4-b653-2fc242e118fe', 'volume_size': 1} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:26:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1897047337',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24355536-0861-49b4-b653-2fc242e118fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f20b13cc6242f6b7f2de64bdc252de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:26:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:26:41Z,use_quota=True,user_id='0c5f519648da49adad073456f049cb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Creating volume 24355536-0861-49b4-b653-2fc242e118fe {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:26:41 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:26:41 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:41 devstack sudo[108076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe 1073741824 Jul 09 10:26:41 devstack sudo[108076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:42 devstack sudo[108076]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe 1073741824" returned: 0 in 0.832s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:42 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:42 devstack sudo[108081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe Jul 09 10:26:42 devstack sudo[108081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:43 devstack sudo[108081]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe" returned: 0 in 0.614s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:26:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:26:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (80cf8591-195c-4a85-b204-c8748893bb42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24355536-0861-49b4-b653-2fc242e118fe', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da711ce4-5416-495b-8592-c18c401b8b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:43 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Volume volume-24355536-0861-49b4-b653-2fc242e118fe (24355536-0861-49b4-b653-2fc242e118fe): created successfully Jul 09 10:26:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da711ce4-5416-495b-8592-c18c401b8b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Flow 'volume_create_manager' (fcf2af02-652f-4c65-9ea9-c9db8491a438) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:26:43 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-74d45909-b2cc-4919-93cb-a4df3e6d049a tempest-ProjectReaderTests-1053199021 None] Created volume successfully. Jul 09 10:26:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-55c37930-5c83-483d-a401-cc5271b08e22 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:26:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-55c37930-5c83-483d-a401-cc5271b08e22 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:26:43 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-55c37930-5c83-483d-a401-cc5271b08e22 tempest-ProjectReaderTests-1053199021 None] Creating offline snapshot dab0b0c5-16f3-4150-b80d-bdb683b1f94d of volume 24355536-0861-49b4-b653-2fc242e118fe {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:26:43 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[72497c97-1569-4cde-b25d-6a322c11e5c5]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:26:43 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55c37930-5c83-483d-a401-cc5271b08e22 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:43 devstack sudo[108090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe Jul 09 10:26:43 devstack sudo[108090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:44 devstack sudo[108090]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55c37930-5c83-483d-a401-cc5271b08e22 tempest-ProjectReaderTests-1053199021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe" returned: 0 in 0.741s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55c37930-5c83-483d-a401-cc5271b08e22 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.dab0b0c5-16f3-4150-b80d-bdb683b1f94d 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:44 devstack sudo[108095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.dab0b0c5-16f3-4150-b80d-bdb683b1f94d 1G Jul 09 10:26:44 devstack sudo[108095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:45 devstack sudo[108095]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55c37930-5c83-483d-a401-cc5271b08e22 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.dab0b0c5-16f3-4150-b80d-bdb683b1f94d 1G" returned: 0 in 0.751s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55c37930-5c83-483d-a401-cc5271b08e22 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24355536-0861-49b4-b653-2fc242e118fe -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.dab0b0c5-16f3-4150-b80d-bdb683b1f94d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:45 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24355536-0861-49b4-b653-2fc242e118fe -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.dab0b0c5-16f3-4150-b80d-bdb683b1f94d Jul 09 10:26:45 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:45 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55c37930-5c83-483d-a401-cc5271b08e22 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24355536-0861-49b4-b653-2fc242e118fe -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.dab0b0c5-16f3-4150-b80d-bdb683b1f94d" returned: 0 in 0.650s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:45 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-55c37930-5c83-483d-a401-cc5271b08e22 tempest-ProjectReaderTests-1053199021 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.dab0b0c5-16f3-4150-b80d-bdb683b1f94d is being set with open permissions: ugo+rw Jul 09 10:26:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55c37930-5c83-483d-a401-cc5271b08e22 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.dab0b0c5-16f3-4150-b80d-bdb683b1f94d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:45 devstack sudo[108106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.dab0b0c5-16f3-4150-b80d-bdb683b1f94d Jul 09 10:26:45 devstack sudo[108106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:46 devstack sudo[108106]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55c37930-5c83-483d-a401-cc5271b08e22 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.dab0b0c5-16f3-4150-b80d-bdb683b1f94d" returned: 0 in 0.637s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55c37930-5c83-483d-a401-cc5271b08e22 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:46 devstack sudo[108110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.info Jul 09 10:26:46 devstack sudo[108110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:47 devstack sudo[108110]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55c37930-5c83-483d-a401-cc5271b08e22 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.info" returned: 0 in 0.620s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:47 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-55c37930-5c83-483d-a401-cc5271b08e22 tempest-ProjectReaderTests-1053199021 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.info is being set with open permissions: ugo+rw Jul 09 10:26:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55c37930-5c83-483d-a401-cc5271b08e22 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:47 devstack sudo[108113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.info Jul 09 10:26:47 devstack sudo[108113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:47 devstack sudo[108113]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-55c37930-5c83-483d-a401-cc5271b08e22 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.info" returned: 0 in 0.626s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-55c37930-5c83-483d-a401-cc5271b08e22 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.103s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:26:47 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-55c37930-5c83-483d-a401-cc5271b08e22 tempest-ProjectReaderTests-1053199021 None] Create snapshot completed successfully Jul 09 10:26:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-dab0b0c5-16f3-4150-b80d-bdb683b1f94d-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:26:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-dab0b0c5-16f3-4150-b80d-bdb683b1f94d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:26:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-quobyte-24355536-0861-49b4-b653-2fc242e118fe" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:26:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-24355536-0861-49b4-b653-2fc242e118fe" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:26:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-quobyte-dab0b0c5-16f3-4150-b80d-bdb683b1f94d" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:26:49 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-dab0b0c5-16f3-4150-b80d-bdb683b1f94d" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:26:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] Deleting offline snapshot dab0b0c5-16f3-4150-b80d-bdb683b1f94d of volume 24355536-0861-49b4-b653-2fc242e118fe {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:26:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] snapshot_file for this snap is: volume-24355536-0861-49b4-b653-2fc242e118fe.dab0b0c5-16f3-4150-b80d-bdb683b1f94d {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:26:49 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a9c89f-b1a3-4eec-a144-5a7791590772]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:26:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.dab0b0c5-16f3-4150-b80d-bdb683b1f94d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:49 devstack sudo[108117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.dab0b0c5-16f3-4150-b80d-bdb683b1f94d Jul 09 10:26:49 devstack sudo[108117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:49 devstack sudo[108117]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.dab0b0c5-16f3-4150-b80d-bdb683b1f94d" returned: 0 in 0.722s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:49 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24355536-0861-49b4-b653-2fc242e118fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:26:49 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cd39249-7d05-49af-8393-30012c8ee49d]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:26:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:49 devstack sudo[108122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe Jul 09 10:26:49 devstack sudo[108122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:50 devstack sudo[108122]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe" returned: 0 in 0.766s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.dab0b0c5-16f3-4150-b80d-bdb683b1f94d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:50 devstack sudo[108127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.dab0b0c5-16f3-4150-b80d-bdb683b1f94d Jul 09 10:26:50 devstack sudo[108127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:51 devstack sudo[108127]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.dab0b0c5-16f3-4150-b80d-bdb683b1f94d" returned: 0 in 0.696s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.dab0b0c5-16f3-4150-b80d-bdb683b1f94d {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:51 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.dab0b0c5-16f3-4150-b80d-bdb683b1f94d Jul 09 10:26:51 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:51 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe.dab0b0c5-16f3-4150-b80d-bdb683b1f94d" returned: 0 in 0.623s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-dab0b0c5-16f3-4150-b80d-bdb683b1f94d" released by "_delete_snapshot" :: held 2.892s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:26:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-24355536-0861-49b4-b653-2fc242e118fe" released by "delete_snapshot" :: held 2.916s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:26:51 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] Created reservations ['0292a13f-3f13-478b-aa05-f9837dc30d62', 'dba55c00-34c9-4c7f-b02b-1e8e92d81dea', '8405c7fe-4ce5-40ce-b67b-1e000f723155', '3ca5d4da-15a8-4d5c-9ec9-03de2b44cf21'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:26:52 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] Delete snapshot completed successfully. Jul 09 10:26:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e2647b5b-4f37-4be6-b06f-70ee03702e30 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-dab0b0c5-16f3-4150-b80d-bdb683b1f94d-delete_snapshot" released by "delete_snapshot" :: held 3.037s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:26:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-98e56c86-cf6a-461f-992f-b8b9e5dc6c27 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-24355536-0861-49b4-b653-2fc242e118fe-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:26:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-98e56c86-cf6a-461f-992f-b8b9e5dc6c27 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-24355536-0861-49b4-b653-2fc242e118fe-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:26:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-98e56c86-cf6a-461f-992f-b8b9e5dc6c27 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-quobyte-24355536-0861-49b4-b653-2fc242e118fe" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:26:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-98e56c86-cf6a-461f-992f-b8b9e5dc6c27 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-24355536-0861-49b4-b653-2fc242e118fe" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:26:52 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[26c3de68-04a4-4f65-a923-c6e446fdc344]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:26:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-98e56c86-cf6a-461f-992f-b8b9e5dc6c27 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:52 devstack sudo[108135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe Jul 09 10:26:52 devstack sudo[108135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:52 devstack sudo[108135]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-98e56c86-cf6a-461f-992f-b8b9e5dc6c27 tempest-ProjectReaderTests-1053199021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe" returned: 0 in 0.725s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-98e56c86-cf6a-461f-992f-b8b9e5dc6c27 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:52 devstack sudo[108140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe Jul 09 10:26:53 devstack sudo[108140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:53 devstack sudo[108140]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-98e56c86-cf6a-461f-992f-b8b9e5dc6c27 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-24355536-0861-49b4-b653-2fc242e118fe" returned: 0 in 0.622s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-98e56c86-cf6a-461f-992f-b8b9e5dc6c27 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-24355536-0861-49b4-b653-2fc242e118fe" released by "delete_volume" :: held 1.402s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:26:53 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-98e56c86-cf6a-461f-992f-b8b9e5dc6c27 tempest-ProjectReaderTests-1053199021 None] Created reservations ['c60871ac-b3c3-4338-b762-097cf317f868', '7c9cec60-6cfc-43d1-9e02-78f148c19194', 'c1985125-0f7d-489d-9b6a-62db1e6c9395', '2953c696-98f0-4be0-8734-192aac3f4043'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:26:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-98e56c86-cf6a-461f-992f-b8b9e5dc6c27 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:26:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-98e56c86-cf6a-461f-992f-b8b9e5dc6c27 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:26:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-98e56c86-cf6a-461f-992f-b8b9e5dc6c27 tempest-ProjectReaderTests-1053199021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:26:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-98e56c86-cf6a-461f-992f-b8b9e5dc6c27 tempest-ProjectReaderTests-1053199021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:26:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-98e56c86-cf6a-461f-992f-b8b9e5dc6c27 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:26:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-98e56c86-cf6a-461f-992f-b8b9e5dc6c27 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:53 devstack sudo[108143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:26:53 devstack sudo[108143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:54 devstack sudo[108143]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-98e56c86-cf6a-461f-992f-b8b9e5dc6c27 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.624s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-98e56c86-cf6a-461f-992f-b8b9e5dc6c27 tempest-ProjectReaderTests-1053199021 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:26:54 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-98e56c86-cf6a-461f-992f-b8b9e5dc6c27 tempest-ProjectReaderTests-1053199021 None] Deleted volume successfully. Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-98e56c86-cf6a-461f-992f-b8b9e5dc6c27 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-24355536-0861-49b4-b653-2fc242e118fe-delete_volume" released by "delete_volume" :: held 2.213s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Flow 'volume_create_manager' (2f6d60c6-62b9-43bb-80aa-4f474faf1c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841cea1b-7ff7-4e80-9c7b-90aa7be7f321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (841cea1b-7ff7-4e80-9c7b-90aa7be7f321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-596349436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7226f01d-a8e0-443a-90b9-803de8a9c741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f20b13cc6242f6b7f2de64bdc252de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:26:55Z,use_quota=True,user_id='0c5f519648da49adad073456f049cb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4aed78-d051-4a4d-b33b-099095e1a5e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e4aed78-d051-4a4d-b33b-099095e1a5e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac80d5b2-8667-432d-93ab-1ac09ec1cc4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac80d5b2-8667-432d-93ab-1ac09ec1cc4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7226f01d-a8e0-443a-90b9-803de8a9c741', 'volume_name': 'volume-7226f01d-a8e0-443a-90b9-803de8a9c741', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbaa8b8b-b676-4253-b5dd-726322ea8597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fbaa8b8b-b676-4253-b5dd-726322ea8597) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea174f5-2c5f-49e7-860d-5adc8ba5abc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:54 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Volume 7226f01d-a8e0-443a-90b9-803de8a9c741: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7226f01d-a8e0-443a-90b9-803de8a9c741', 'volume_size': 1} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:26:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-596349436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7226f01d-a8e0-443a-90b9-803de8a9c741,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f20b13cc6242f6b7f2de64bdc252de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:26:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:26:55Z,use_quota=True,user_id='0c5f519648da49adad073456f049cb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Creating volume 7226f01d-a8e0-443a-90b9-803de8a9c741 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:26:54 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:26:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:54 devstack sudo[108146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741 1073741824 Jul 09 10:26:54 devstack sudo[108146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:55 devstack sudo[108146]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741 1073741824" returned: 0 in 0.794s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:55 devstack sudo[108151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741 Jul 09 10:26:55 devstack sudo[108151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:56 devstack sudo[108151]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741" returned: 0 in 0.616s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:26:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.450s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:26:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ea174f5-2c5f-49e7-860d-5adc8ba5abc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7226f01d-a8e0-443a-90b9-803de8a9c741', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59870dee-3322-4953-9f7d-dddfb403ee66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:26:56 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Volume volume-7226f01d-a8e0-443a-90b9-803de8a9c741 (7226f01d-a8e0-443a-90b9-803de8a9c741): created successfully Jul 09 10:26:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59870dee-3322-4953-9f7d-dddfb403ee66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:26:56 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Flow 'volume_create_manager' (2f6d60c6-62b9-43bb-80aa-4f474faf1c02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:26:56 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-6e8b906a-8ec3-4345-8cd4-55ef6e7b1632 tempest-ProjectReaderTests-1053199021 None] Created volume successfully. Jul 09 10:26:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2bc20436-dd73-452a-a6d8-d715a06be247 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:26:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2bc20436-dd73-452a-a6d8-d715a06be247 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:26:56 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-2bc20436-dd73-452a-a6d8-d715a06be247 tempest-ProjectReaderTests-1053199021 None] Creating offline snapshot 3f25cc13-ac0f-43e8-8da3-b4f4692f4433 of volume 7226f01d-a8e0-443a-90b9-803de8a9c741 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:26:56 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d80d5430-6d53-40bd-babd-1e5c2012033a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:26:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2bc20436-dd73-452a-a6d8-d715a06be247 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:57 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741 Jul 09 10:26:57 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:57 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2bc20436-dd73-452a-a6d8-d715a06be247 tempest-ProjectReaderTests-1053199021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741" returned: 0 in 0.726s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2bc20436-dd73-452a-a6d8-d715a06be247 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.3f25cc13-ac0f-43e8-8da3-b4f4692f4433 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:57 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.3f25cc13-ac0f-43e8-8da3-b4f4692f4433 1G Jul 09 10:26:57 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:58 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2bc20436-dd73-452a-a6d8-d715a06be247 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.3f25cc13-ac0f-43e8-8da3-b4f4692f4433 1G" returned: 0 in 0.780s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2bc20436-dd73-452a-a6d8-d715a06be247 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7226f01d-a8e0-443a-90b9-803de8a9c741 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.3f25cc13-ac0f-43e8-8da3-b4f4692f4433 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:58 devstack sudo[108166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7226f01d-a8e0-443a-90b9-803de8a9c741 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.3f25cc13-ac0f-43e8-8da3-b4f4692f4433 Jul 09 10:26:58 devstack sudo[108166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:59 devstack sudo[108166]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2bc20436-dd73-452a-a6d8-d715a06be247 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7226f01d-a8e0-443a-90b9-803de8a9c741 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.3f25cc13-ac0f-43e8-8da3-b4f4692f4433" returned: 0 in 0.646s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:59 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-2bc20436-dd73-452a-a6d8-d715a06be247 tempest-ProjectReaderTests-1053199021 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.3f25cc13-ac0f-43e8-8da3-b4f4692f4433 is being set with open permissions: ugo+rw Jul 09 10:26:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2bc20436-dd73-452a-a6d8-d715a06be247 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.3f25cc13-ac0f-43e8-8da3-b4f4692f4433 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:59 devstack sudo[108171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.3f25cc13-ac0f-43e8-8da3-b4f4692f4433 Jul 09 10:26:59 devstack sudo[108171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:26:59 devstack sudo[108171]: pam_unix(sudo:session): session closed for user root Jul 09 10:26:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2bc20436-dd73-452a-a6d8-d715a06be247 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.3f25cc13-ac0f-43e8-8da3-b4f4692f4433" returned: 0 in 0.614s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:26:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2bc20436-dd73-452a-a6d8-d715a06be247 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:26:59 devstack sudo[108174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.info Jul 09 10:26:59 devstack sudo[108174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:00 devstack sudo[108174]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2bc20436-dd73-452a-a6d8-d715a06be247 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.info" returned: 0 in 0.657s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:00 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-2bc20436-dd73-452a-a6d8-d715a06be247 tempest-ProjectReaderTests-1053199021 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.info is being set with open permissions: ugo+rw Jul 09 10:27:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2bc20436-dd73-452a-a6d8-d715a06be247 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:00 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.info Jul 09 10:27:00 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:01 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-2bc20436-dd73-452a-a6d8-d715a06be247 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.info" returned: 0 in 0.639s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-2bc20436-dd73-452a-a6d8-d715a06be247 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.135s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:27:01 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-2bc20436-dd73-452a-a6d8-d715a06be247 tempest-ProjectReaderTests-1053199021 None] Create snapshot completed successfully Jul 09 10:27:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-3f25cc13-ac0f-43e8-8da3-b4f4692f4433-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:27:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] Lock "cinder-3f25cc13-ac0f-43e8-8da3-b4f4692f4433-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:27:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-quobyte-7226f01d-a8e0-443a-90b9-803de8a9c741" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:27:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-7226f01d-a8e0-443a-90b9-803de8a9c741" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:27:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-quobyte-3f25cc13-ac0f-43e8-8da3-b4f4692f4433" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:27:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-3f25cc13-ac0f-43e8-8da3-b4f4692f4433" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:27:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] Deleting offline snapshot 3f25cc13-ac0f-43e8-8da3-b4f4692f4433 of volume 7226f01d-a8e0-443a-90b9-803de8a9c741 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:27:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] snapshot_file for this snap is: volume-7226f01d-a8e0-443a-90b9-803de8a9c741.3f25cc13-ac0f-43e8-8da3-b4f4692f4433 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:27:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d70f0a19-9282-4c82-91b5-f930d0a5c6fc]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:27:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.3f25cc13-ac0f-43e8-8da3-b4f4692f4433 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:02 devstack sudo[108181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.3f25cc13-ac0f-43e8-8da3-b4f4692f4433 Jul 09 10:27:02 devstack sudo[108181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:02 devstack sudo[108181]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.3f25cc13-ac0f-43e8-8da3-b4f4692f4433" returned: 0 in 0.705s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:02 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7226f01d-a8e0-443a-90b9-803de8a9c741(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:27:02 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0aec050-f6b6-4428-a3c7-f3ffdf4c3b3a]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:27:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:03 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741 Jul 09 10:27:03 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:03 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741" returned: 0 in 0.730s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:03 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.3f25cc13-ac0f-43e8-8da3-b4f4692f4433 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:03 devstack sudo[108192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.3f25cc13-ac0f-43e8-8da3-b4f4692f4433 Jul 09 10:27:03 devstack sudo[108192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:04 devstack sudo[108192]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.3f25cc13-ac0f-43e8-8da3-b4f4692f4433" returned: 0 in 0.701s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:04 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.3f25cc13-ac0f-43e8-8da3-b4f4692f4433 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:04 devstack sudo[108197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.3f25cc13-ac0f-43e8-8da3-b4f4692f4433 Jul 09 10:27:04 devstack sudo[108197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:05 devstack sudo[108197]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741.3f25cc13-ac0f-43e8-8da3-b4f4692f4433" returned: 0 in 0.645s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-3f25cc13-ac0f-43e8-8da3-b4f4692f4433" released by "_delete_snapshot" :: held 2.866s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:27:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-7226f01d-a8e0-443a-90b9-803de8a9c741" released by "delete_snapshot" :: held 2.887s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:27:05 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] Created reservations ['af7d396d-afb8-4cf2-b4b1-25cfff0a7f21', 'b6ba1e6c-e1d7-4cbf-82c3-07b41e5b9614', '0c21b216-985f-400e-9534-29d24ecad634', '3105ef87-0e46-4101-ad66-b5679fc269fc'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:27:05 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] Delete snapshot completed successfully. Jul 09 10:27:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-e32dd355-637f-4bcf-8869-064b858d387b tempest-ProjectReaderTests-1053199021 None] Lock "cinder-3f25cc13-ac0f-43e8-8da3-b4f4692f4433-delete_snapshot" released by "delete_snapshot" :: held 3.071s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:27:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1a500e9a-909e-4571-ba9c-f41b41a7fa82 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-7226f01d-a8e0-443a-90b9-803de8a9c741-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:27:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1a500e9a-909e-4571-ba9c-f41b41a7fa82 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-7226f01d-a8e0-443a-90b9-803de8a9c741-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:27:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1a500e9a-909e-4571-ba9c-f41b41a7fa82 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-quobyte-7226f01d-a8e0-443a-90b9-803de8a9c741" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:27:05 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1a500e9a-909e-4571-ba9c-f41b41a7fa82 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-7226f01d-a8e0-443a-90b9-803de8a9c741" acquired by "delete_volume" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:27:05 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3c93307-aa55-4e45-9309-def51a70db92]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:27:05 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1a500e9a-909e-4571-ba9c-f41b41a7fa82 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:05 devstack sudo[108202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741 Jul 09 10:27:05 devstack sudo[108202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:06 devstack sudo[108202]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1a500e9a-909e-4571-ba9c-f41b41a7fa82 tempest-ProjectReaderTests-1053199021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741" returned: 0 in 0.727s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1a500e9a-909e-4571-ba9c-f41b41a7fa82 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:06 devstack sudo[108207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741 Jul 09 10:27:06 devstack sudo[108207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:06 devstack sudo[108207]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1a500e9a-909e-4571-ba9c-f41b41a7fa82 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-7226f01d-a8e0-443a-90b9-803de8a9c741" returned: 0 in 0.632s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:06 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1a500e9a-909e-4571-ba9c-f41b41a7fa82 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-7226f01d-a8e0-443a-90b9-803de8a9c741" released by "delete_volume" :: held 1.415s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:27:06 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-1a500e9a-909e-4571-ba9c-f41b41a7fa82 tempest-ProjectReaderTests-1053199021 None] Created reservations ['2ec532d3-160e-42a5-b54e-23cc3b947de8', '54265841-eef0-440d-b688-8a07c0309a5b', 'fab13fdc-da47-43db-8730-ffe7541cb9d4', '4de84d8d-c379-4919-94fe-223a48e970fe'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:27:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1a500e9a-909e-4571-ba9c-f41b41a7fa82 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:27:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1a500e9a-909e-4571-ba9c-f41b41a7fa82 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:27:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1a500e9a-909e-4571-ba9c-f41b41a7fa82 tempest-ProjectReaderTests-1053199021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:27:06 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-1a500e9a-909e-4571-ba9c-f41b41a7fa82 tempest-ProjectReaderTests-1053199021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:27:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-1a500e9a-909e-4571-ba9c-f41b41a7fa82 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:27:06 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1a500e9a-909e-4571-ba9c-f41b41a7fa82 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:06 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:27:06 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:07 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:07 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-1a500e9a-909e-4571-ba9c-f41b41a7fa82 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.619s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:07 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-1a500e9a-909e-4571-ba9c-f41b41a7fa82 tempest-ProjectReaderTests-1053199021 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:27:07 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-1a500e9a-909e-4571-ba9c-f41b41a7fa82 tempest-ProjectReaderTests-1053199021 None] Deleted volume successfully. Jul 09 10:27:07 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-1a500e9a-909e-4571-ba9c-f41b41a7fa82 tempest-ProjectReaderTests-1053199021 None] Lock "cinder-7226f01d-a8e0-443a-90b9-803de8a9c741-delete_volume" released by "delete_volume" :: held 2.207s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:27:07 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:27:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Flow 'volume_create_manager' (a281372f-8813-4c34-91fc-115045eedc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:27:07 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331721c3-f206-4506-873c-c860ac34528a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (331721c3-f206-4506-873c-c860ac34528a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1301293454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0d11a6-3ea1-4499-b53f-892bdb1f23a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f20b13cc6242f6b7f2de64bdc252de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:27:08Z,use_quota=True,user_id='0c5f519648da49adad073456f049cb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e43f03b-dae8-49e2-b89c-917a420c8a01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e43f03b-dae8-49e2-b89c-917a420c8a01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1f9223-2d19-4fbf-adf2-9b51122355d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f1f9223-2d19-4fbf-adf2-9b51122355d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d0d11a6-3ea1-4499-b53f-892bdb1f23a7', 'volume_name': 'volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191dcad9-2fef-42af-ab90-b384fb127486) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191dcad9-2fef-42af-ab90-b384fb127486) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41b5499-8560-4933-b62b-49a2409599b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:08 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Volume 1d0d11a6-3ea1-4499-b53f-892bdb1f23a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7', 'volume_size': 1} Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:27:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1301293454',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d0d11a6-3ea1-4499-b53f-892bdb1f23a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d4f20b13cc6242f6b7f2de64bdc252de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:27:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:27:08Z,use_quota=True,user_id='0c5f519648da49adad073456f049cb2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Creating volume 1d0d11a6-3ea1-4499-b53f-892bdb1f23a7 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:27:08 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:08 devstack sudo[108213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7 1073741824 Jul 09 10:27:08 devstack sudo[108213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:08 devstack sudo[108213]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7 1073741824" returned: 0 in 0.775s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:08 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:08 devstack sudo[108219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7 Jul 09 10:27:08 devstack sudo[108219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:09 devstack sudo[108219]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7" returned: 0 in 0.615s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:09 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] <== create_volume: return (1425ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:27:09 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.428s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:27:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f41b5499-8560-4933-b62b-49a2409599b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66fca743-c40c-4198-ba58-53153c822f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:09 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Volume volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7 (1d0d11a6-3ea1-4499-b53f-892bdb1f23a7): created successfully Jul 09 10:27:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66fca743-c40c-4198-ba58-53153c822f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:09 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Flow 'volume_create_manager' (a281372f-8813-4c34-91fc-115045eedc1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:27:09 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-a85092c2-42bf-44c4-b7f6-eecf263919d2 tempest-ProjectReaderTests-1053199021 None] Created volume successfully. Jul 09 10:27:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-be3cb264-7c0b-4485-a2f7-a195bf0873ac tempest-ProjectReaderTests-1053199021 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:27:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-be3cb264-7c0b-4485-a2f7-a195bf0873ac tempest-ProjectReaderTests-1053199021 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:27:10 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-be3cb264-7c0b-4485-a2f7-a195bf0873ac tempest-ProjectReaderTests-1053199021 None] Creating offline snapshot 5fc5f671-63ab-4114-aea8-af2be9021df6 of volume 1d0d11a6-3ea1-4499-b53f-892bdb1f23a7 {{(pid=87192) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 09 10:27:10 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[5eecbbe4-5198-41b9-9a6e-94286da9e25e]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:27:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be3cb264-7c0b-4485-a2f7-a195bf0873ac tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:10 devstack sudo[108222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7 Jul 09 10:27:10 devstack sudo[108222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:10 devstack sudo[108222]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be3cb264-7c0b-4485-a2f7-a195bf0873ac tempest-ProjectReaderTests-1053199021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7" returned: 0 in 0.714s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:10 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be3cb264-7c0b-4485-a2f7-a195bf0873ac tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.5fc5f671-63ab-4114-aea8-af2be9021df6 1G {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:10 devstack sudo[108227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.5fc5f671-63ab-4114-aea8-af2be9021df6 1G Jul 09 10:27:10 devstack sudo[108227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:11 devstack sudo[108227]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be3cb264-7c0b-4485-a2f7-a195bf0873ac tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.5fc5f671-63ab-4114-aea8-af2be9021df6 1G" returned: 0 in 0.765s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:11 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be3cb264-7c0b-4485-a2f7-a195bf0873ac tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.5fc5f671-63ab-4114-aea8-af2be9021df6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:11 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.5fc5f671-63ab-4114-aea8-af2be9021df6 Jul 09 10:27:11 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:12 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be3cb264-7c0b-4485-a2f7-a195bf0873ac tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7 -F qcow2 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.5fc5f671-63ab-4114-aea8-af2be9021df6" returned: 0 in 0.666s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:12 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-be3cb264-7c0b-4485-a2f7-a195bf0873ac tempest-ProjectReaderTests-1053199021 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.5fc5f671-63ab-4114-aea8-af2be9021df6 is being set with open permissions: ugo+rw Jul 09 10:27:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be3cb264-7c0b-4485-a2f7-a195bf0873ac tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.5fc5f671-63ab-4114-aea8-af2be9021df6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:12 devstack sudo[108238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.5fc5f671-63ab-4114-aea8-af2be9021df6 Jul 09 10:27:12 devstack sudo[108238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:12 devstack sudo[108238]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be3cb264-7c0b-4485-a2f7-a195bf0873ac tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.5fc5f671-63ab-4114-aea8-af2be9021df6" returned: 0 in 0.610s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:12 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be3cb264-7c0b-4485-a2f7-a195bf0873ac tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:13 devstack sudo[108241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.info Jul 09 10:27:13 devstack sudo[108241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:13 devstack sudo[108241]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be3cb264-7c0b-4485-a2f7-a195bf0873ac tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.info" returned: 0 in 0.632s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:13 devstack cinder-volume[87192]: WARNING cinder.volume.drivers.remotefs [None req-be3cb264-7c0b-4485-a2f7-a195bf0873ac tempest-ProjectReaderTests-1053199021 None] /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.info is being set with open permissions: ugo+rw Jul 09 10:27:13 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be3cb264-7c0b-4485-a2f7-a195bf0873ac tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.info {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:13 devstack sudo[108244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.info Jul 09 10:27:13 devstack sudo[108244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:14 devstack sudo[108244]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-be3cb264-7c0b-4485-a2f7-a195bf0873ac tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.info" returned: 0 in 0.616s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:14 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-be3cb264-7c0b-4485-a2f7-a195bf0873ac tempest-ProjectReaderTests-1053199021 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.088s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:27:14 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-be3cb264-7c0b-4485-a2f7-a195bf0873ac tempest-ProjectReaderTests-1053199021 None] Create snapshot completed successfully Jul 09 10:27:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-5fc5f671-63ab-4114-aea8-af2be9021df6-delete_snapshot" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:27:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] Lock "cinder-5fc5f671-63ab-4114-aea8-af2be9021df6-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:27:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-quobyte-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7" by "delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:27:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7" acquired by "delete_snapshot" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:27:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-quobyte-5fc5f671-63ab-4114-aea8-af2be9021df6" by "_delete_snapshot" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:27:15 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-5fc5f671-63ab-4114-aea8-af2be9021df6" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:27:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] Deleting offline snapshot 5fc5f671-63ab-4114-aea8-af2be9021df6 of volume 1d0d11a6-3ea1-4499-b53f-892bdb1f23a7 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 09 10:27:15 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] snapshot_file for this snap is: volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.5fc5f671-63ab-4114-aea8-af2be9021df6 {{(pid=87192) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 09 10:27:15 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8663912-d0f3-4cbb-bca7-ecfb66222fd0]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:27:15 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.5fc5f671-63ab-4114-aea8-af2be9021df6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:15 devstack sudo[108247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.5fc5f671-63ab-4114-aea8-af2be9021df6 Jul 09 10:27:15 devstack sudo[108247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:16 devstack sudo[108247]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.5fc5f671-63ab-4114-aea8-af2be9021df6" returned: 0 in 0.728s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:16 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87192) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 09 10:27:16 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7e8f5c4-b62d-4030-a597-8bd07bd07179]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:27:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:16 devstack sudo[108252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7 Jul 09 10:27:16 devstack sudo[108252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:16 devstack sudo[108252]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7" returned: 0 in 0.712s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:16 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.5fc5f671-63ab-4114-aea8-af2be9021df6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:16 devstack sudo[108257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.5fc5f671-63ab-4114-aea8-af2be9021df6 Jul 09 10:27:16 devstack sudo[108257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:17 devstack sudo[108257]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.5fc5f671-63ab-4114-aea8-af2be9021df6" returned: 0 in 0.720s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:17 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.5fc5f671-63ab-4114-aea8-af2be9021df6 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:17 devstack sudo[108262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.5fc5f671-63ab-4114-aea8-af2be9021df6 Jul 09 10:27:17 devstack sudo[108262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:18 devstack sudo[108262]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7.5fc5f671-63ab-4114-aea8-af2be9021df6" returned: 0 in 0.623s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-5fc5f671-63ab-4114-aea8-af2be9021df6" released by "_delete_snapshot" :: held 2.876s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:27:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7" released by "delete_snapshot" :: held 2.901s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:27:18 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] Created reservations ['d71f81ec-d86a-4b07-86bc-74fb793062bc', '28a975d9-7a72-4352-b3c6-10d2597646a0', '6a1fa76d-563a-431b-ae2d-fa245be1cfb7', '9c3bae48-a23d-4e06-88a1-65934156dda8'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:27:18 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] Delete snapshot completed successfully. Jul 09 10:27:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-46fe4c92-4ece-4702-bb69-3035c8a0b1cd tempest-ProjectReaderTests-1053199021 None] Lock "cinder-5fc5f671-63ab-4114-aea8-af2be9021df6-delete_snapshot" released by "delete_snapshot" :: held 3.024s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:27:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-07e9c573-dc8c-4291-9094-5ed2f80ed6cd tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:27:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-07e9c573-dc8c-4291-9094-5ed2f80ed6cd tempest-ProjectReaderTests-1053199021 None] Lock "cinder-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:27:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-07e9c573-dc8c-4291-9094-5ed2f80ed6cd tempest-ProjectReaderTests-1053199021 None] Acquiring lock "cinder-quobyte-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:27:18 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-07e9c573-dc8c-4291-9094-5ed2f80ed6cd tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:27:18 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d7a956-6bca-4e49-ae7a-ec9f71ed1695]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:27:18 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07e9c573-dc8c-4291-9094-5ed2f80ed6cd tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:18 devstack sudo[108266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7 Jul 09 10:27:18 devstack sudo[108266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:19 devstack sudo[108266]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07e9c573-dc8c-4291-9094-5ed2f80ed6cd tempest-ProjectReaderTests-1053199021 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7" returned: 0 in 0.726s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:19 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07e9c573-dc8c-4291-9094-5ed2f80ed6cd tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:19 devstack sudo[108271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7 Jul 09 10:27:19 devstack sudo[108271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:20 devstack sudo[108271]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07e9c573-dc8c-4291-9094-5ed2f80ed6cd tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7" returned: 0 in 0.634s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-07e9c573-dc8c-4291-9094-5ed2f80ed6cd tempest-ProjectReaderTests-1053199021 None] Lock "cinder-quobyte-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7" released by "delete_volume" :: held 1.412s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:27:20 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-07e9c573-dc8c-4291-9094-5ed2f80ed6cd tempest-ProjectReaderTests-1053199021 None] Created reservations ['ab0fd331-4bd0-4c4a-9927-6c3f6e62acc4', 'ae03d592-96b6-4c93-996a-6e338620dcd7', '375f30b7-9de7-468f-b18a-e370bb3e2b4b', '47d67540-de25-4152-b081-bbd6f6f7ee74'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:27:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-07e9c573-dc8c-4291-9094-5ed2f80ed6cd tempest-ProjectReaderTests-1053199021 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:27:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-07e9c573-dc8c-4291-9094-5ed2f80ed6cd tempest-ProjectReaderTests-1053199021 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:27:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-07e9c573-dc8c-4291-9094-5ed2f80ed6cd tempest-ProjectReaderTests-1053199021 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:27:20 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-07e9c573-dc8c-4291-9094-5ed2f80ed6cd tempest-ProjectReaderTests-1053199021 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:27:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-07e9c573-dc8c-4291-9094-5ed2f80ed6cd tempest-ProjectReaderTests-1053199021 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:27:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07e9c573-dc8c-4291-9094-5ed2f80ed6cd tempest-ProjectReaderTests-1053199021 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:20 devstack sudo[108274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:27:20 devstack sudo[108274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:20 devstack sudo[108274]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:20 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-07e9c573-dc8c-4291-9094-5ed2f80ed6cd tempest-ProjectReaderTests-1053199021 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.627s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:20 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-07e9c573-dc8c-4291-9094-5ed2f80ed6cd tempest-ProjectReaderTests-1053199021 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:27:20 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-07e9c573-dc8c-4291-9094-5ed2f80ed6cd tempest-ProjectReaderTests-1053199021 None] Deleted volume successfully. Jul 09 10:27:20 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-07e9c573-dc8c-4291-9094-5ed2f80ed6cd tempest-ProjectReaderTests-1053199021 None] Lock "cinder-1d0d11a6-3ea1-4499-b53f-892bdb1f23a7-delete_volume" released by "delete_volume" :: held 2.220s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:27:29 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:UPDATE=70,cinder:DELETE=7,cinder:SELECT=63,cinder:INSERT=23 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:27:29 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=46,cinder:INSERT=16,cinder:UPDATE=70,cinder:DELETE=5 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:27:29 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:27:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:27:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:27:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:27:29 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:27:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:27:29 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:29 devstack sudo[108279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:27:29 devstack sudo[108279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:30 devstack sudo[108279]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:30 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.680s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:30 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:27:30 devstack cinder-volume[87192]: DEBUG oslo_service.periodic_task [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] Running periodic task VolumeManager._thread_info {{(pid=87192) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 09 10:27:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread count: 28 {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 09 10:27:30 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-04564fc8-e091-4c70-a457-c0046853aa53 None None] thread info: [<_MainThread(MainThread, started 137607301030016)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87192) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 09 10:27:43 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:27:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Flow 'volume_create_manager' (fa79c6d1-e114-46e0-949f-bcd5074c397d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:27:43 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ebe6a5-5c05-4e3d-a02b-d04a91bdac4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ebe6a5-5c05-4e3d-a02b-d04a91bdac4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1554937495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb62299f-b61f-40e9-b59d-033b2b54a52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6572a079e6461eb64768b2212c36d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:27:44Z,use_quota=True,user_id='ca65478df6db4ef588b048eb5f3d6cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70acb23e-243c-45c5-9374-5ef6b05d1a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (70acb23e-243c-45c5-9374-5ef6b05d1a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2426a97c-a3ed-4587-966e-c9c9185ed68c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2426a97c-a3ed-4587-966e-c9c9185ed68c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb62299f-b61f-40e9-b59d-033b2b54a52f', 'volume_name': 'volume-bb62299f-b61f-40e9-b59d-033b2b54a52f', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab4c4cd-6552-4148-a3d3-efc16833cb2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ab4c4cd-6552-4148-a3d3-efc16833cb2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef2b3ed-d443-4929-9daf-953df432265e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:44 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Volume bb62299f-b61f-40e9-b59d-033b2b54a52f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb62299f-b61f-40e9-b59d-033b2b54a52f', 'volume_size': 1} Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:27:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1554937495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb62299f-b61f-40e9-b59d-033b2b54a52f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6572a079e6461eb64768b2212c36d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:27:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:27:44Z,use_quota=True,user_id='ca65478df6db4ef588b048eb5f3d6cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Creating volume bb62299f-b61f-40e9-b59d-033b2b54a52f {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:27:44 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bb62299f-b61f-40e9-b59d-033b2b54a52f 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:44 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bb62299f-b61f-40e9-b59d-033b2b54a52f 1073741824 Jul 09 10:27:44 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:44 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bb62299f-b61f-40e9-b59d-033b2b54a52f 1073741824" returned: 0 in 0.782s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:44 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bb62299f-b61f-40e9-b59d-033b2b54a52f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:44 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bb62299f-b61f-40e9-b59d-033b2b54a52f Jul 09 10:27:44 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:45 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bb62299f-b61f-40e9-b59d-033b2b54a52f" returned: 0 in 0.626s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:45 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] <== create_volume: return (1448ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:27:45 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.451s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:27:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef2b3ed-d443-4929-9daf-953df432265e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb62299f-b61f-40e9-b59d-033b2b54a52f', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a5a0902-fdc6-44f2-b51e-67756e99cc5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:45 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Volume volume-bb62299f-b61f-40e9-b59d-033b2b54a52f (bb62299f-b61f-40e9-b59d-033b2b54a52f): created successfully Jul 09 10:27:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a5a0902-fdc6-44f2-b51e-67756e99cc5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:45 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Flow 'volume_create_manager' (fa79c6d1-e114-46e0-949f-bcd5074c397d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:27:45 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-b2e5481c-dc65-49bd-8ffe-9aa417d311c1 tempest-ProjectReaderTests-1465103461 None] Created volume successfully. Jul 09 10:27:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ee88fa07-1fb8-4dd9-a50d-82abb7432e5d tempest-ProjectReaderTests-1465103461 None] Acquiring lock "cinder-bb62299f-b61f-40e9-b59d-033b2b54a52f-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:27:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ee88fa07-1fb8-4dd9-a50d-82abb7432e5d tempest-ProjectReaderTests-1465103461 None] Lock "cinder-bb62299f-b61f-40e9-b59d-033b2b54a52f-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:27:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ee88fa07-1fb8-4dd9-a50d-82abb7432e5d tempest-ProjectReaderTests-1465103461 None] Acquiring lock "cinder-quobyte-bb62299f-b61f-40e9-b59d-033b2b54a52f" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:27:46 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ee88fa07-1fb8-4dd9-a50d-82abb7432e5d tempest-ProjectReaderTests-1465103461 None] Lock "cinder-quobyte-bb62299f-b61f-40e9-b59d-033b2b54a52f" acquired by "delete_volume" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:27:46 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da691e2-436d-4bce-8598-1a4be6788cfa]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:27:46 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ee88fa07-1fb8-4dd9-a50d-82abb7432e5d tempest-ProjectReaderTests-1465103461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bb62299f-b61f-40e9-b59d-033b2b54a52f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:46 devstack sudo[108333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bb62299f-b61f-40e9-b59d-033b2b54a52f Jul 09 10:27:46 devstack sudo[108333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:47 devstack sudo[108333]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ee88fa07-1fb8-4dd9-a50d-82abb7432e5d tempest-ProjectReaderTests-1465103461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bb62299f-b61f-40e9-b59d-033b2b54a52f" returned: 0 in 0.758s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ee88fa07-1fb8-4dd9-a50d-82abb7432e5d tempest-ProjectReaderTests-1465103461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bb62299f-b61f-40e9-b59d-033b2b54a52f {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:47 devstack sudo[108339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bb62299f-b61f-40e9-b59d-033b2b54a52f Jul 09 10:27:47 devstack sudo[108339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:47 devstack sudo[108339]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ee88fa07-1fb8-4dd9-a50d-82abb7432e5d tempest-ProjectReaderTests-1465103461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-bb62299f-b61f-40e9-b59d-033b2b54a52f" returned: 0 in 0.618s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:47 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ee88fa07-1fb8-4dd9-a50d-82abb7432e5d tempest-ProjectReaderTests-1465103461 None] Lock "cinder-quobyte-bb62299f-b61f-40e9-b59d-033b2b54a52f" released by "delete_volume" :: held 1.415s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:27:47 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-ee88fa07-1fb8-4dd9-a50d-82abb7432e5d tempest-ProjectReaderTests-1465103461 None] Created reservations ['a8392130-2a01-4e41-9a41-24449ea9ceec', '5d57a489-464d-4089-af42-7c6e32b41e8b', 'cf998f54-c999-4b0f-bff9-2f2adafd8bf7', '4e6dcdfd-7023-4ba1-856d-d210be60a508'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:27:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ee88fa07-1fb8-4dd9-a50d-82abb7432e5d tempest-ProjectReaderTests-1465103461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:27:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ee88fa07-1fb8-4dd9-a50d-82abb7432e5d tempest-ProjectReaderTests-1465103461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:27:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ee88fa07-1fb8-4dd9-a50d-82abb7432e5d tempest-ProjectReaderTests-1465103461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:27:47 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-ee88fa07-1fb8-4dd9-a50d-82abb7432e5d tempest-ProjectReaderTests-1465103461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:27:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-ee88fa07-1fb8-4dd9-a50d-82abb7432e5d tempest-ProjectReaderTests-1465103461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:27:47 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ee88fa07-1fb8-4dd9-a50d-82abb7432e5d tempest-ProjectReaderTests-1465103461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:47 devstack sudo[108342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:27:47 devstack sudo[108342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:48 devstack sudo[108342]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-ee88fa07-1fb8-4dd9-a50d-82abb7432e5d tempest-ProjectReaderTests-1465103461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.647s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-ee88fa07-1fb8-4dd9-a50d-82abb7432e5d tempest-ProjectReaderTests-1465103461 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:27:48 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-ee88fa07-1fb8-4dd9-a50d-82abb7432e5d tempest-ProjectReaderTests-1465103461 None] Deleted volume successfully. Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-ee88fa07-1fb8-4dd9-a50d-82abb7432e5d tempest-ProjectReaderTests-1465103461 None] Lock "cinder-bb62299f-b61f-40e9-b59d-033b2b54a52f-delete_volume" released by "delete_volume" :: held 2.243s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Flow 'volume_create_manager' (403e7d51-33dc-4f1f-83ed-97298500ec15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0340e67e-c492-4425-9d3e-da7afd5816fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0340e67e-c492-4425-9d3e-da7afd5816fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-893484028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc11503-afb9-4fd6-8ff5-701fe19164fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6572a079e6461eb64768b2212c36d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:27:49Z,use_quota=True,user_id='ca65478df6db4ef588b048eb5f3d6cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d66124d-b2fe-4c3a-b0e4-11bccf6e8131) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d66124d-b2fe-4c3a-b0e4-11bccf6e8131) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91851b0c-4a8b-4ec1-b50b-16daca3ee660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91851b0c-4a8b-4ec1-b50b-16daca3ee660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8fc11503-afb9-4fd6-8ff5-701fe19164fe', 'volume_name': 'volume-8fc11503-afb9-4fd6-8ff5-701fe19164fe', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f05b72a-4bc2-4227-ac0e-fb6ed21551d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f05b72a-4bc2-4227-ac0e-fb6ed21551d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd0362d-8f7d-48c5-82fa-0a5a9bd57631) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:48 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Volume 8fc11503-afb9-4fd6-8ff5-701fe19164fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8fc11503-afb9-4fd6-8ff5-701fe19164fe', 'volume_size': 1} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:27:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-893484028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8fc11503-afb9-4fd6-8ff5-701fe19164fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6572a079e6461eb64768b2212c36d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:27:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:27:49Z,use_quota=True,user_id='ca65478df6db4ef588b048eb5f3d6cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Creating volume 8fc11503-afb9-4fd6-8ff5-701fe19164fe {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:27:48 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:27:48 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8fc11503-afb9-4fd6-8ff5-701fe19164fe 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:48 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8fc11503-afb9-4fd6-8ff5-701fe19164fe 1073741824 Jul 09 10:27:48 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:49 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8fc11503-afb9-4fd6-8ff5-701fe19164fe 1073741824" returned: 0 in 0.782s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:49 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8fc11503-afb9-4fd6-8ff5-701fe19164fe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:49 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8fc11503-afb9-4fd6-8ff5-701fe19164fe Jul 09 10:27:49 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:50 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8fc11503-afb9-4fd6-8ff5-701fe19164fe" returned: 0 in 0.614s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:50 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] <== create_volume: return (1433ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:27:50 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.436s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:27:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (abd0362d-8f7d-48c5-82fa-0a5a9bd57631) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8fc11503-afb9-4fd6-8ff5-701fe19164fe', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5309a12a-b2d7-4565-a711-903e424f393a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:50 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Volume volume-8fc11503-afb9-4fd6-8ff5-701fe19164fe (8fc11503-afb9-4fd6-8ff5-701fe19164fe): created successfully Jul 09 10:27:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5309a12a-b2d7-4565-a711-903e424f393a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:50 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Flow 'volume_create_manager' (403e7d51-33dc-4f1f-83ed-97298500ec15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:27:50 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-78d2d552-9848-4c25-9b66-9934c6851d53 tempest-ProjectReaderTests-1465103461 None] Created volume successfully. Jul 09 10:27:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c97e3ea6-77e8-4fb5-99e9-67f0d3c3f4fc tempest-ProjectReaderTests-1465103461 None] Acquiring lock "cinder-8fc11503-afb9-4fd6-8ff5-701fe19164fe-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:27:50 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c97e3ea6-77e8-4fb5-99e9-67f0d3c3f4fc tempest-ProjectReaderTests-1465103461 None] Lock "cinder-8fc11503-afb9-4fd6-8ff5-701fe19164fe-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:27:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c97e3ea6-77e8-4fb5-99e9-67f0d3c3f4fc tempest-ProjectReaderTests-1465103461 None] Acquiring lock "cinder-quobyte-8fc11503-afb9-4fd6-8ff5-701fe19164fe" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:27:51 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c97e3ea6-77e8-4fb5-99e9-67f0d3c3f4fc tempest-ProjectReaderTests-1465103461 None] Lock "cinder-quobyte-8fc11503-afb9-4fd6-8ff5-701fe19164fe" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:27:51 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[9959b84b-fa51-4b13-b400-8049716962be]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:27:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c97e3ea6-77e8-4fb5-99e9-67f0d3c3f4fc tempest-ProjectReaderTests-1465103461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8fc11503-afb9-4fd6-8ff5-701fe19164fe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:51 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8fc11503-afb9-4fd6-8ff5-701fe19164fe Jul 09 10:27:51 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:51 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c97e3ea6-77e8-4fb5-99e9-67f0d3c3f4fc tempest-ProjectReaderTests-1465103461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8fc11503-afb9-4fd6-8ff5-701fe19164fe" returned: 0 in 0.725s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:51 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c97e3ea6-77e8-4fb5-99e9-67f0d3c3f4fc tempest-ProjectReaderTests-1465103461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8fc11503-afb9-4fd6-8ff5-701fe19164fe {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:51 devstack sudo[108360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8fc11503-afb9-4fd6-8ff5-701fe19164fe Jul 09 10:27:51 devstack sudo[108360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:52 devstack sudo[108360]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c97e3ea6-77e8-4fb5-99e9-67f0d3c3f4fc tempest-ProjectReaderTests-1465103461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-8fc11503-afb9-4fd6-8ff5-701fe19164fe" returned: 0 in 0.618s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:52 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c97e3ea6-77e8-4fb5-99e9-67f0d3c3f4fc tempest-ProjectReaderTests-1465103461 None] Lock "cinder-quobyte-8fc11503-afb9-4fd6-8ff5-701fe19164fe" released by "delete_volume" :: held 1.379s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:27:52 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-c97e3ea6-77e8-4fb5-99e9-67f0d3c3f4fc tempest-ProjectReaderTests-1465103461 None] Created reservations ['b5ffd760-c2e9-4bf3-85c4-21d86bbedc5b', '4cc51bdc-71dc-41e0-9c51-d7e7589b22c6', 'bde7e053-6fa8-4249-91d0-153d00b73cfd', '0730b216-648f-4f34-957a-da7e748f3aa1'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:27:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c97e3ea6-77e8-4fb5-99e9-67f0d3c3f4fc tempest-ProjectReaderTests-1465103461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:27:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c97e3ea6-77e8-4fb5-99e9-67f0d3c3f4fc tempest-ProjectReaderTests-1465103461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:27:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c97e3ea6-77e8-4fb5-99e9-67f0d3c3f4fc tempest-ProjectReaderTests-1465103461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:27:52 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-c97e3ea6-77e8-4fb5-99e9-67f0d3c3f4fc tempest-ProjectReaderTests-1465103461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:27:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-c97e3ea6-77e8-4fb5-99e9-67f0d3c3f4fc tempest-ProjectReaderTests-1465103461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:27:52 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c97e3ea6-77e8-4fb5-99e9-67f0d3c3f4fc tempest-ProjectReaderTests-1465103461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:52 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:27:52 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:53 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-c97e3ea6-77e8-4fb5-99e9-67f0d3c3f4fc tempest-ProjectReaderTests-1465103461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.643s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-c97e3ea6-77e8-4fb5-99e9-67f0d3c3f4fc tempest-ProjectReaderTests-1465103461 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:27:53 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-c97e3ea6-77e8-4fb5-99e9-67f0d3c3f4fc tempest-ProjectReaderTests-1465103461 None] Deleted volume successfully. Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-c97e3ea6-77e8-4fb5-99e9-67f0d3c3f4fc tempest-ProjectReaderTests-1465103461 None] Lock "cinder-8fc11503-afb9-4fd6-8ff5-701fe19164fe-delete_volume" released by "delete_volume" :: held 2.208s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Flow 'volume_create_manager' (e3b6a7c8-ac3f-4371-973c-753eacd9ccf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c737bfdb-e11f-4523-b802-8381d510f0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c737bfdb-e11f-4523-b802-8381d510f0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1336691010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0bbb2a-9337-40f3-988f-f3010addfb42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6572a079e6461eb64768b2212c36d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:27:54Z,use_quota=True,user_id='ca65478df6db4ef588b048eb5f3d6cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1209e8-ede8-4ac2-b907-14b4132ab105) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a1209e8-ede8-4ac2-b907-14b4132ab105) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358f9cbf-bb51-4419-818c-f681407745d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (358f9cbf-bb51-4419-818c-f681407745d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b0bbb2a-9337-40f3-988f-f3010addfb42', 'volume_name': 'volume-6b0bbb2a-9337-40f3-988f-f3010addfb42', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc056c5-0d6f-448e-b83a-756f963fc2d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dcc056c5-0d6f-448e-b83a-756f963fc2d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc82df28-9c9d-4ed9-b762-211380cbd669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:53 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Volume 6b0bbb2a-9337-40f3-988f-f3010addfb42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b0bbb2a-9337-40f3-988f-f3010addfb42', 'volume_size': 1} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:27:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1336691010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b0bbb2a-9337-40f3-988f-f3010addfb42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6572a079e6461eb64768b2212c36d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:27:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:27:54Z,use_quota=True,user_id='ca65478df6db4ef588b048eb5f3d6cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Creating volume 6b0bbb2a-9337-40f3-988f-f3010addfb42 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:27:53 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:27:53 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6b0bbb2a-9337-40f3-988f-f3010addfb42 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:53 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6b0bbb2a-9337-40f3-988f-f3010addfb42 1073741824 Jul 09 10:27:53 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:54 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6b0bbb2a-9337-40f3-988f-f3010addfb42 1073741824" returned: 0 in 0.779s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:54 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6b0bbb2a-9337-40f3-988f-f3010addfb42 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:54 devstack sudo[108372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6b0bbb2a-9337-40f3-988f-f3010addfb42 Jul 09 10:27:54 devstack sudo[108372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:55 devstack sudo[108372]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6b0bbb2a-9337-40f3-988f-f3010addfb42" returned: 0 in 0.643s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:55 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] <== create_volume: return (1457ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:27:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.460s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:27:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc82df28-9c9d-4ed9-b762-211380cbd669) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b0bbb2a-9337-40f3-988f-f3010addfb42', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d75035-84fc-46fb-bdfe-6a31813ad0dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:55 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Volume volume-6b0bbb2a-9337-40f3-988f-f3010addfb42 (6b0bbb2a-9337-40f3-988f-f3010addfb42): created successfully Jul 09 10:27:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (37d75035-84fc-46fb-bdfe-6a31813ad0dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:55 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Flow 'volume_create_manager' (e3b6a7c8-ac3f-4371-973c-753eacd9ccf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:27:55 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-03940e48-a6a2-4e11-944f-7ca77d25a131 tempest-ProjectReaderTests-1465103461 None] Created volume successfully. Jul 09 10:27:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-941bfbd7-3cb4-4864-91af-80c0ff9888ea tempest-ProjectReaderTests-1465103461 None] Acquiring lock "cinder-6b0bbb2a-9337-40f3-988f-f3010addfb42-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:27:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-941bfbd7-3cb4-4864-91af-80c0ff9888ea tempest-ProjectReaderTests-1465103461 None] Lock "cinder-6b0bbb2a-9337-40f3-988f-f3010addfb42-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:27:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-941bfbd7-3cb4-4864-91af-80c0ff9888ea tempest-ProjectReaderTests-1465103461 None] Acquiring lock "cinder-quobyte-6b0bbb2a-9337-40f3-988f-f3010addfb42" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:27:55 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-941bfbd7-3cb4-4864-91af-80c0ff9888ea tempest-ProjectReaderTests-1465103461 None] Lock "cinder-quobyte-6b0bbb2a-9337-40f3-988f-f3010addfb42" acquired by "delete_volume" :: waited 0.013s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:27:55 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[e79ffec0-3bd5-4e8e-bbfe-a43772847f35]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:27:55 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-941bfbd7-3cb4-4864-91af-80c0ff9888ea tempest-ProjectReaderTests-1465103461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6b0bbb2a-9337-40f3-988f-f3010addfb42 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:55 devstack sudo[108375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6b0bbb2a-9337-40f3-988f-f3010addfb42 Jul 09 10:27:55 devstack sudo[108375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:56 devstack sudo[108375]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-941bfbd7-3cb4-4864-91af-80c0ff9888ea tempest-ProjectReaderTests-1465103461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6b0bbb2a-9337-40f3-988f-f3010addfb42" returned: 0 in 0.716s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:56 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-941bfbd7-3cb4-4864-91af-80c0ff9888ea tempest-ProjectReaderTests-1465103461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6b0bbb2a-9337-40f3-988f-f3010addfb42 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:56 devstack sudo[108380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6b0bbb2a-9337-40f3-988f-f3010addfb42 Jul 09 10:27:56 devstack sudo[108380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:57 devstack sudo[108380]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-941bfbd7-3cb4-4864-91af-80c0ff9888ea tempest-ProjectReaderTests-1465103461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-6b0bbb2a-9337-40f3-988f-f3010addfb42" returned: 0 in 0.617s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-941bfbd7-3cb4-4864-91af-80c0ff9888ea tempest-ProjectReaderTests-1465103461 None] Lock "cinder-quobyte-6b0bbb2a-9337-40f3-988f-f3010addfb42" released by "delete_volume" :: held 1.368s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:27:57 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-941bfbd7-3cb4-4864-91af-80c0ff9888ea tempest-ProjectReaderTests-1465103461 None] Created reservations ['46dfe357-0c1e-406b-b61c-a4d9abd48273', 'ff8d2520-abfc-4bb8-abe4-8a748893537d', 'd6877e30-bedb-4159-a7db-313b76b12975', '434755ea-99ad-48d8-ab25-7af72eb85645'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:27:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-941bfbd7-3cb4-4864-91af-80c0ff9888ea tempest-ProjectReaderTests-1465103461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:27:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-941bfbd7-3cb4-4864-91af-80c0ff9888ea tempest-ProjectReaderTests-1465103461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:27:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-941bfbd7-3cb4-4864-91af-80c0ff9888ea tempest-ProjectReaderTests-1465103461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:27:57 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-941bfbd7-3cb4-4864-91af-80c0ff9888ea tempest-ProjectReaderTests-1465103461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:27:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-941bfbd7-3cb4-4864-91af-80c0ff9888ea tempest-ProjectReaderTests-1465103461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:27:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-941bfbd7-3cb4-4864-91af-80c0ff9888ea tempest-ProjectReaderTests-1465103461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:57 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:27:57 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:57 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:57 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-941bfbd7-3cb4-4864-91af-80c0ff9888ea tempest-ProjectReaderTests-1465103461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.609s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:57 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-941bfbd7-3cb4-4864-91af-80c0ff9888ea tempest-ProjectReaderTests-1465103461 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:27:57 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-941bfbd7-3cb4-4864-91af-80c0ff9888ea tempest-ProjectReaderTests-1465103461 None] Deleted volume successfully. Jul 09 10:27:57 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-941bfbd7-3cb4-4864-91af-80c0ff9888ea tempest-ProjectReaderTests-1465103461 None] Lock "cinder-6b0bbb2a-9337-40f3-988f-f3010addfb42-delete_volume" released by "delete_volume" :: held 2.155s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87192) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Flow 'volume_create_manager' (8af89d72-2ba5-428c-8e5f-8e7af444d006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b72983-e5f2-4991-8e70-d111435fe21a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7b72983-e5f2-4991-8e70-d111435fe21a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-64297176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e5ab3c-f55d-4d2a-8886-85b1552bf545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6572a079e6461eb64768b2212c36d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:27:58Z,use_quota=True,user_id='ca65478df6db4ef588b048eb5f3d6cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbab0a7-1976-4fcd-b3f6-1d543827138c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bbab0a7-1976-4fcd-b3f6-1d543827138c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (841d2632-2cd0-4c34-ab20-391d5e539da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (841d2632-2cd0-4c34-ab20-391d5e539da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32e5ab3c-f55d-4d2a-8886-85b1552bf545', 'volume_name': 'volume-32e5ab3c-f55d-4d2a-8886-85b1552bf545', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc55f5e5-16a4-4bc8-8bd8-66a60501845d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc55f5e5-16a4-4bc8-8bd8-66a60501845d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8a7eb0-12bf-459c-a586-98d1ab3417a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:58 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Volume 32e5ab3c-f55d-4d2a-8886-85b1552bf545: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32e5ab3c-f55d-4d2a-8886-85b1552bf545', 'volume_size': 1} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-09T08:27:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-64297176',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32e5ab3c-f55d-4d2a-8886-85b1552bf545,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab6572a079e6461eb64768b2212c36d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-09T08:27:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-09T08:27:58Z,use_quota=True,user_id='ca65478df6db4ef588b048eb5f3d6cd4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(47a798bd-d5ca-45ae-9cbb-eab707d71834),volume_type_id=47a798bd-d5ca-45ae-9cbb-eab707d71834)}" {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.remotefs [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Creating volume 32e5ab3c-f55d-4d2a-8886-85b1552bf545 {{(pid=87192) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Selected osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 as target Quobyte volume. {{(pid=87192) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 09 10:27:58 devstack cinder-volume[87192]: INFO cinder.volume.drivers.remotefs [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] casted to osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550 Jul 09 10:27:58 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-32e5ab3c-f55d-4d2a-8886-85b1552bf545 1073741824 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:58 devstack sudo[108386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-32e5ab3c-f55d-4d2a-8886-85b1552bf545 1073741824 Jul 09 10:27:58 devstack sudo[108386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:59 devstack sudo[108386]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-32e5ab3c-f55d-4d2a-8886-85b1552bf545 1073741824" returned: 0 in 0.775s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-32e5ab3c-f55d-4d2a-8886-85b1552bf545 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:27:59 devstack sudo[108393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-32e5ab3c-f55d-4d2a-8886-85b1552bf545 Jul 09 10:27:59 devstack sudo[108393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:27:59 devstack sudo[108393]: pam_unix(sudo:session): session closed for user root Jul 09 10:27:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-32e5ab3c-f55d-4d2a-8886-85b1552bf545" returned: 0 in 0.624s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:27:59 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] <== create_volume: return (1442ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'} {{(pid=87192) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 09 10:27:59 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.445s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:27:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad8a7eb0-12bf-459c-a586-98d1ab3417a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32e5ab3c-f55d-4d2a-8886-85b1552bf545', 'volume_size': 1}' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85569d82-4c40-44b9-b476-b916fa7d1013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 09 10:27:59 devstack cinder-volume[87192]: INFO cinder.volume.flows.manager.create_volume [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Volume volume-32e5ab3c-f55d-4d2a-8886-85b1552bf545 (32e5ab3c-f55d-4d2a-8886-85b1552bf545): created successfully Jul 09 10:27:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85569d82-4c40-44b9-b476-b916fa7d1013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87192) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 09 10:27:59 devstack cinder-volume[87192]: DEBUG cinder.volume.manager [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Flow 'volume_create_manager' (8af89d72-2ba5-428c-8e5f-8e7af444d006) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87192) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 09 10:27:59 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-9d7c9ab3-c014-4590-b283-19cad3a10869 tempest-ProjectReaderTests-1465103461 None] Created volume successfully. Jul 09 10:28:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-446be80b-e1ca-4c4a-a344-c9986ff3b828 tempest-ProjectReaderTests-1465103461 None] Acquiring lock "cinder-32e5ab3c-f55d-4d2a-8886-85b1552bf545-delete_volume" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:28:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-446be80b-e1ca-4c4a-a344-c9986ff3b828 tempest-ProjectReaderTests-1465103461 None] Lock "cinder-32e5ab3c-f55d-4d2a-8886-85b1552bf545-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:28:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-446be80b-e1ca-4c4a-a344-c9986ff3b828 tempest-ProjectReaderTests-1465103461 None] Acquiring lock "cinder-quobyte-32e5ab3c-f55d-4d2a-8886-85b1552bf545" by "delete_volume" {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 09 10:28:00 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-446be80b-e1ca-4c4a-a344-c9986ff3b828 tempest-ProjectReaderTests-1465103461 None] Lock "cinder-quobyte-32e5ab3c-f55d-4d2a-8886-85b1552bf545" acquired by "delete_volume" :: waited 0.015s {{(pid=87192) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 09 10:28:00 devstack cinder-volume[87192]: DEBUG oslo.privsep.daemon [-] privsep: reply[fae33d18-0555-4d91-bda0-a62d1e3959e9]: (4, 'qcow2') {{(pid=88324) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 09 10:28:00 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-446be80b-e1ca-4c4a-a344-c9986ff3b828 tempest-ProjectReaderTests-1465103461 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-32e5ab3c-f55d-4d2a-8886-85b1552bf545 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:28:00 devstack sudo[108396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-32e5ab3c-f55d-4d2a-8886-85b1552bf545 Jul 09 10:28:00 devstack sudo[108396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:28:01 devstack sudo[108396]: pam_unix(sudo:session): session closed for user root Jul 09 10:28:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-446be80b-e1ca-4c4a-a344-c9986ff3b828 tempest-ProjectReaderTests-1465103461 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-32e5ab3c-f55d-4d2a-8886-85b1552bf545" returned: 0 in 0.712s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:28:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-446be80b-e1ca-4c4a-a344-c9986ff3b828 tempest-ProjectReaderTests-1465103461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-32e5ab3c-f55d-4d2a-8886-85b1552bf545 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:28:01 devstack sudo[108402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-32e5ab3c-f55d-4d2a-8886-85b1552bf545 Jul 09 10:28:01 devstack sudo[108402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:28:01 devstack sudo[108402]: pam_unix(sudo:session): session closed for user root Jul 09 10:28:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-446be80b-e1ca-4c4a-a344-c9986ff3b828 tempest-ProjectReaderTests-1465103461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3/volume-32e5ab3c-f55d-4d2a-8886-85b1552bf545" returned: 0 in 0.624s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:28:01 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-446be80b-e1ca-4c4a-a344-c9986ff3b828 tempest-ProjectReaderTests-1465103461 None] Lock "cinder-quobyte-32e5ab3c-f55d-4d2a-8886-85b1552bf545" released by "delete_volume" :: held 1.371s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:28:01 devstack cinder-volume[87192]: DEBUG cinder.quota [None req-446be80b-e1ca-4c4a-a344-c9986ff3b828 tempest-ProjectReaderTests-1465103461 None] Created reservations ['a5b23047-8fe4-4f4e-bd44-4a2311e2b271', '4ef3c787-8fbf-4151-8fb5-ba8a2c729ab7', 'ba42b251-72e4-4db8-98cb-dcebbfd19d2a', 'b79da260-6fde-4afa-8f5d-cb35832784f9'] {{(pid=87192) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 09 10:28:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-446be80b-e1ca-4c4a-a344-c9986ff3b828 tempest-ProjectReaderTests-1465103461 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 09 10:28:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-446be80b-e1ca-4c4a-a344-c9986ff3b828 tempest-ProjectReaderTests-1465103461 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 09 10:28:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-446be80b-e1ca-4c4a-a344-c9986ff3b828 tempest-ProjectReaderTests-1465103461 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550': None} {{(pid=87192) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 09 10:28:01 devstack cinder-volume[87192]: DEBUG cinder.volume.drivers.quobyte [None req-446be80b-e1ca-4c4a-a344-c9986ff3b828 tempest-ProjectReaderTests-1465103461 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-d041ae53-598f-4aca-a2ac-cc1c646b3550'] {{(pid=87192) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 09 10:28:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.lockutils [None req-446be80b-e1ca-4c4a-a344-c9986ff3b828 tempest-ProjectReaderTests-1465103461 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87192) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 09 10:28:01 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-446be80b-e1ca-4c4a-a344-c9986ff3b828 tempest-ProjectReaderTests-1465103461 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 09 10:28:01 devstack sudo[108406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3 Jul 09 10:28:01 devstack sudo[108406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 09 10:28:02 devstack sudo[108406]: pam_unix(sudo:session): session closed for user root Jul 09 10:28:02 devstack cinder-volume[87192]: DEBUG oslo_concurrency.processutils [None req-446be80b-e1ca-4c4a-a344-c9986ff3b828 tempest-ProjectReaderTests-1465103461 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/3aa1c02cf384c250c34de81920f8c6e3" returned: 0 in 0.616s {{(pid=87192) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 09 10:28:02 devstack cinder-volume[87192]: DEBUG cinder.manager [None req-446be80b-e1ca-4c4a-a344-c9986ff3b828 tempest-ProjectReaderTests-1465103461 None] Notifying Schedulers of capabilities ... {{(pid=87192) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 09 10:28:02 devstack cinder-volume[87192]: INFO cinder.volume.manager [None req-446be80b-e1ca-4c4a-a344-c9986ff3b828 tempest-ProjectReaderTests-1465103461 None] Deleted volume successfully. Jul 09 10:28:02 devstack cinder-volume[87192]: DEBUG cinder.coordination [None req-446be80b-e1ca-4c4a-a344-c9986ff3b828 tempest-ProjectReaderTests-1465103461 None] Lock "cinder-32e5ab3c-f55d-4d2a-8886-85b1552bf545-delete_volume" released by "delete_volume" :: held 2.165s {{(pid=87192) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 09 10:28:11 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=30,cinder:UPDATE=41,cinder:INSERT=11,cinder:DELETE=3 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 09 10:28:12 devstack cinder-volume[87192]: DEBUG dbcounter [-] [87192] Writing DB stats cinder:SELECT=26,cinder:INSERT=9,cinder:UPDATE=47,cinder:DELETE=5 {{(pid=87192) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}